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ABSTRACT 

Cuyahoga Community College ! s (CCC) Unified 
Technologies Center (UTC) collaborated with three Cleveland area 
manufacturing companies in a workplace literacy project. The project 
provided job-relr.ted mathematics and communications programs for 302 
employees who needed basic skills upgrading to improve their job 
performance. The project implementation process involved the 
following: establishment of an operations/advisory committee; 
information meetings; instructor selection; basic skills job/task 
analysis; employee assessment; advising sessions; curriculum 
design/development ; train- the- trainer/ instructor or i en tat ion ; 
establishment of a multimedia learning center; training; and 
evaluation activities. Four courses were designed and developed for 
each company: Mathematics on the Job I and II and Communications on 
the Job I and II. The objectives for each course differed from 
company to company, based on th job task analysis and the 
mathematics and communication? requirements of each job. (The 18-page 
report is accompanied by extensive attachments, including the 
following: copies of the job task analysis for each of the three 
partner companies ; examples of test results given to each company; 
samples of the Individual Learning Plan; a course description and 
general outline for each course; samples of criterion-referenced 
assessments; reports compiled from student evaluation forms completed 
at the end of each course; and a final evaluation report.) (YLB) 
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NATIONAL WORKPLACE LITERACY PROGRAM 
QUANTITATIVE INFORMATION 



PROJECT PERIOD: MAY, 1992 - OCTOBER, 1993 

1. Target Number To Be Served: 302 



Total Number Served: 



320 



3. 



Total Number Served: Company Breakdown 



Company Name 


. Planned 


Actual 


American Steel and Wire 


70 


O 1 


Cleveland Wood Products 


60 


76 


TRW, Inc., VaVe Division 


72 


151 


Zircoa, Incorporated 


100 


93 


TOTAL 


302 


320 



Jobs Analyzed at Each Site 
Company Name 



Jobs 



Cleveland Wood Products 


Machine Operator, Brush Operator, Brush Assembler 


TRW, Inc., Valve Division 


Automation Operator, Heavy Duty Machine Operator, Visual and Floor 
Inspector 


Zircoa, Incorporated 


BGM Operator, Fine Grain Batch Mixer, Grain Plant Operator/Shift 
Leader, Kiln Operator/Loader, Machinist Class "A", Maintenance 
Tradesworker, Packer Inspector Loader, Press Operator, 
Slipcaster/Slipcast Specialist. 



5. Federal Funds Allocated: 
Federal Funds Used: 

6. Matching Funds / In-Kind Planned: 
Matching Funds / In-Kind Actual: 

7. Value Worker Release Time: 



$270,120 
$ 

$128,140 

$300, 640 (includes value of worker release time) 
$192,000 



American Steel and Wire did not participate as a grant partner due to conflict of interest with 
another Cleveland area training provider The number of participants planned to be served at 
American Steel and Wire was divided among the remaining three partner companies. 
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Sections of Each Course Provided (twenty hours each): 



9. 
10. 



Mathematics-on-the Job I 
Mathematics-on-the-Job II 
Communications-on-the-Job t 
Communications-on-the-Job II 
Communications-on-the-Job III 

Total Sections: 

Total Instructional Hours: 



17 
16 
11 
13 
6 

63 

1,260 (63 sections X 20 hrs.) 



Total Training Hours (for 320 participants) 12,800 (320 participants X 40 hrs.) 



11. Participant Data: 



a. 


Age of Participants 


#of 


% of 






particioants 


total 




16-20 years 


4 


1.2 








10 1 




31-39 


96 


30.0 




40-49 


94 


29.4 




50-60 


67 


20.9 




Over 60 


27 


8.4 


b. 


Sex: 


#of 


% of 






participants 


lalsl 




1 . Number of Males 


243 


76 




2. Number of Females 


77 


24 


c. 


Race/Ethnicity: 


#of 


% of 






Darticioants 


total 




1. White 


228 


71.3 




2. Black 


36 


11.1 




3. Hispanic 


48 


15.0 




4. American Indian / 








Alaska Native 


2 


2.1 




5. Asian/Pacific Islander 


6 


.5 


2 


This course was provided for those Zircoa employees who 



i.e. who scored above 12.9 grade equivalent on the English Comprehension and Vocabulary sections 
of the TABE. After assessing Zircoa Inc.'s entire employee base, there were far fewer employees who 
needed the basic skills training planned for this grant. However, the company requested appropriate 
training for this group. 
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d. Number of Participants with English as Second Language: 12 

e. Number of years employed with partner Company: 

# of % of 

participants total 

1. 1-10 years 198 62.0 

2. 11-20 years 88 27.4 

3. 21-30 years 33 10.3 

4. 31-40 years 0 0 

5. 41-50 years 1 .3 

f. Outcomes 

1 . Standardized Test of Adult Basic Education (TABE) 

Significant improvement was shown if the following areas: 

Reading percentage +7.18 

Reading stanine level +0.58 

Reading grade equivalent +0.56 

Math standard score +12.42 

Math percentage +6.18 

Math stanine level +0.53 

Math grade equivalent +0.76 

2. Tested Higher on Standardized Test of Applied Literacy Skills (TALS) 

Group sample was too small to show significant changes. 

3. Criterion-Referenced Tests 

Significant change occurred in both classes: 

First class +24.69 
Second class +29.45 
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NATIONAL WORKPLACE LITERACY PROJECT 



PROJECT PERIOD: MAY 1992 THROUGH JUNE 1993 
FINAL REPORT 

I. INTRODUCTION 

Cuyahoga Community College's (CCC) Unified Technologies Center (UTC) has partnered with three 
Cleveland area manufacturing companies, Cleveland Wood Products, TRW., Inc., Valve Division, and 
Zircoa, Incorporated in this workplace literacy project. The goal of the project was to provide job-related 
mathematics and communications programs for 302 employees who needed basic skills upgrading in order 
to better perform their jobs. All project objectives and timelines were achieved as anticipated. 

II. PARTICIPANT COMPANIES 

Originally there were four companies that partnered CCC/UTC: American Steel & Wire, Cleveland Wood 
Products, TRW, Inc., Valve Division and Zircoa, Inc. American Steel & Wire withdrew from the project early 
in the project because of a conflict of interest with another training provider. A letter of withdrawal was sent 
to the Department of Education by American Steel and Wire. 

III. PROJECT IMPLEMENTATION PROCESS 

The implementation of the National Workplace Literacy Project at each of the partner companies followed 
a systematic process. Individual differences in company policies, procedures, culture, and style, caused 
slight variations in the process. In general, the project work conducted at the partner's sites was carried 
out consecutively. The following is the general process, followed at all companies. Variations are detailed 
in the company-by-company report later in this document. 



A. 


Establish Operations/Advisory Committee • 


B. 


Conduct Information Meetings 


C. 


Select Instructors 


D. 


Conduct Basic Skills Job/Task Analysis 


E. 


Conduct Employee Assessment 


F. 


Conduct Advising Sessions 


G. 


Design/Develop Curriculum 


H. 


Conduct Train-the-Trainer/lnstructor Orientation 


I. 


Set up Multi-Media Learning Center 


J. 


Schedule/Conduct Training 


K. 


Conduct Evaluation Activities 



A. ESTABUSH OPERATIONS/ADVISORY COMMITTEE 

The basic process followed at each of the companies for delivery of the grant included the 
formation of a training operations/advisory team ideally comprised of a cross-section of 
organizational levels (upper management, supervisory, union management, and i<ourly). The 
function of this team was to assist UTC in marketing the program throughout the company, 
scheduling assessments and training sessions, identifying and confirming critical job tasks, and 
reviewing curriculum. Representatives from CCC/UTC's project team along with the membership 
of the operations/advisory team guided each company through the assessment, delivery and 
evaluation phases of the project. 
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CONDUCT INFORMATION MEETINGS 

Prior to beginning the delivery of services at each company, UTC staff conducted information 
sessions at each of the partner sites. These sessions, scheduled on each of three shifts, were 
designed to establish trust and to familiarize potential participants with the project. Sessions 
included information on: 

► employee assessment 

► design, development, delivery of training 

► job task analysis 

► advising sessions 

► evaluation 

Time was allotted at the end of each information session to answer participant questions about the 
program. 

SELECT INSTRUCTORS 

The identification, selection and confirmation of qualified instructors is critical to the success of this 
project. Qualified instructors must be able to: 

► understand instructional goals of program, i.e., improved performance on job-specific 
reading tasks 

► administer and interpret pretest results and develop individualized education plans for 
participants 

► effectively utilize functionally contextual (job) materials to teach basic skills for information 
processing 

► successfully model the thinking strategies used in job reading task procedures 

► conduct whole group instruction, emphasizing discussion and eliciting input from 
participants (rather than lecture) 

► conduct instruction with several small groups of three to five participants simultaneously, 
to foster teamwork and interaction which transfers to the job 

► design and monitor highly motivational individual instruction to maintain participants 1 interest 
and performance levels during independent activities 

► develop rapport with employees and demonstrate effective classroom management, 
maintaining high levels of time on task and increases in performance 

► demonstrate flexibility, fine tuning instructional goals 

CONDUCT BASIC SKILLS JOB/TASK ANALYSIS 

Each company selected job areas to be analyzed. The process used to analyze the basic skills 
levels needed to perform these jobs included the following steps: 

► Interview "master performers' 4 of each job 

These are individuals who perform the job in an exemplary manner - in a way the 
company ideally would wanted all employees to perform that job. 

► Observe "master performers" doing the job 

Videotaping the master performer as he/she performed the critical functions of the 
job proved to be a very effective means of capturing the process for future 
reference. 
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► Gather job-related documents 

' All documents, manuals, standard operating procedures, charts, forms, and graphs 
were collected and integrated into the course materials. Photographs of 
equipment, gages, micrometers, etc. were scanned into course materials. 
Interviews and observations were carried out when possible by the CCC/UTC 
course developer and/or the instructors. A comprehensive review of the job-related 
documents resulted in a determination of reading level required to perform the job. 
Based upon the interview, observations, and document analysis, similar 
determinations were made about mathematics and computation levels required to 
effectively perform the jobs. 

The outcome from the job/task analysis inch/ 'ed the basic skills levels in mathematics (computation 
and problem solving) and communications (written and verbal) required for competent performance 
of each job. 

Copies of the Job/Task Analysis Reports for each company are included in Attachment A. 
CONDUCT EMPLOYEE ASSESSMENT 

Employees were assessed to determine their current level of knowledge and skill in the areas of 
mathematics and communications. 

► Test of Adult Basic Education (TABE) 

CCC/UTC staff used the Test of Adult Basic Education (TABE) for the initial 
assessment of participants. This standardized assessment provided standard 
scores, stanine scores, and grade-equivalent scores for each employee tested. 
Results of both the basic skills job analysis and the TABE assessments were used 
to develop customized curriculum for each company. Additionally, the TABE gave 
CCC/UTC staff a baseline for facing participants in the program. The TABE was 
also administered to all participants in the project at the end of the delivery phase 
in order to assess possible gains made by project participants. 

> Work Environment Scale (WES) 

The Work Environment Scale was used to assess employee attitudes about work. 
It was administered prior to the training and again at the completion of the training 
delivery. 

Test of Applied Literacy Skills (TALS) 

This assessment was given to selected participants at the beginning and end of 
training delivery in order to pilot test it as a standardized instrument that could 
potentially be used as an alternative to the more academic Test of Adult Basic 
Education. Workers related more easily to the TALS because it assesses basic 
skills using work-related vocabulary, computation, problems, situations, and 
scenarios. 

> Demographics 

In addition to assessing skills levels of employees, the assessment also captured 
demographic information on each participant. This information included age 
ranges, sex, race, and number of years with company. 

The identification and recruiting of individuals to participate in the program was accomplished 
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through employee assessment. Those individuals scoring below sixth grade level on the 
mathematics and reading sections of the Test of Adult Basic Education (TABE) were enrolled in 
the Mathematics I and Communications I courses. Those individuals scoring between the sixth and 
ninth grade level were place in the Mathematics II and Communications II courses. 

At two cf the companies, training was mandatory for individuals demonstrating basic skills 
deficiencies on the TABE. At the third company, individuals were required to attend the first two 
classes and then could decide to drop or continue. 

Examples of test result reports given to each company are included in Attachment B. Individual 
score reports were prepared and mailed to each individual's home. 

CONDUCT ADVISING SESSIONS 

Project staff conducted individual advising sessions to accomplish the following: 

► explain assessment scores, results 

► explain strategy for placement into specific courses 

► complete individual learning plan 

► get commitment of participation 

► familiarize participants with learning center 

Individual learning plans were completed for each individual as part of advising session. Project 
staff gathered in-depth information regarding educational goals, training programs taken, learning 
mode preference, highest grade completed, latest educational experience, expectations of the 
program, and computer comfort level from each participant. This information was recorded and 
subsequently used by instructors to enhance the learning experience of each individual. A 
commitment of participation was secured from each individual and learning contracts were signed 
by each individual and the instructor. Samples of individual learning plans are included in 
Attachment C. 

DESIGN/DEVELOP CURRICULUM 

The course materials for each company were designed and developed around a set of core 
competencies. Core materials provided the framework within which job-related materials were 
integrated. Job-related vocabulary was used for vocabulary-building activities; problem solving 
activities were based on actual job situations; forms, tickets, and other work materials were 
designed as work sheets, practice sheets, and simulation activities.. Criterion-referenced 
assessments were also developed using job-related materials. 

There were four courses designed and developed for each company: Mathematics-on-the-Job I, 
Mathematics-on-the-Job II, Convnunicatk>ns-on-the-Job I, and Communications-on4he-Job II. The 

objectives for each course differed from company to company, based upon the job task analysis, 
and the mathematics and communications requirements of each job. In addition a Communications 
III course was designed and developed for one company whose employees possessed high skill 
levels in the communications area.Training materials were revised after each delivery based upon 
input from instructors and participants. 

All participant materials were published using the UTC desktop publishing systems at the UTC. 
Customized binders bearing the name and logo of the partner organization were prepared for each 
individual. UTC staff contributed hundreds of hours copying, collating, cutting, pasting, scanning, 
and preparing participant materials for delivery. 
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The design/development of curriculum was the most time consuming component of the entire 
project. Development should begin early in the planning stages to ensure timely completion, 
increased use of off-the-shelf materials would expedite the course development process with 
customization and job-related materials integrated in appropriate ways. 

Course descriptions and general outlines for each of the courses developed for this project are 
included in Attachment D. Samples of criterion-referenced assessments are included in Attachment 
E. A complete set of course materials has been sent to the Department of Education as well as 
to the Clearinghouse on Adutt Education and Literacy, the ERIC Clearinghouse on Adutt, Career, 
and Vocational Education, and the East Central Curriculum Coordination Center. 

CONDUCT TRAIN-THE-TRAINER/INSTRUCTOR ORIENTATION 

In order to prepare instructors for delivery, staff development sessions were conducted by UTC 
staff. These sessions followed the Jorie Philippi model for staff development and focused on the 
following: 

► explanation and rationale of functional context instruction 

► overview of program design and all curriculum components 

► background on workplace literacy programs at UTC 

► explanation of how participants enter and exit program 

► process for administering and scoring tests 

► strategy for interpreting test results and placing individuals in courses 

► demonstration of how to complete an individual learning plan 

► suggestions for conducting effective advising sessions 

► instructional strategies for delivering curriculum 

► ideas on how to motivate learners 

► suggestions on how to provide sufficient time on task for practicing new skills 

► provide supplemental materials or support as needed 

► ideas on how to adapt delivery strategies to meet needs of low-level or ESL learners 

► demonstration of how a typical instructional session should be conducted, including 
scheduling of activities 

► methods for record keeping anJ assessment of learner progress 

► orientation to the learning center including equipment usage, instructional materials 
content/technical review, scheduling procedures, record keeping procedures 

SET UP MULTI-MEDIA LEARNING CENTER 

Space was provided at each partner site (sizes vary some were unused storage closets) were 
transformed into learning centers where grant participants couid individually practice the skills 
learned in the classroom. 

Most of the instructional equipment and courseware used in the learning centers was provided in- 
kind by CCC/UTC. Funds from the grant were allocated to purchase an interactive video system. 
The instructional technology and accompanying programs used in the learning center are listed 
below. 

► Reading Horizons/Mastery Drill and Practice - CD ROM 

► Ferranti Interactive Mathematics - Interactive Videodisc 

► Skills Bank Mathematics and Communications - Computer-Based Instruction 

► Another Page Reading Improvement - Video-Based Instruction 

► Mavis Beacon Introduction to Keyboarding - Computer-Based Instruction 
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CCCAJTC staff assisted with the transporting and set-up of instructional equipment in each of the 
learning centers. Instructional courseware was also loaded and tested prior to use by grant 
participants. Orientations to the learning centers were conducted by grant staff for instructors as 
well as participants. 

J. SCHEDULE/CONDUCT TRAINING 

During this phase, UTC staff worked with the training operations/advisory committee at each 
company to coordinate the scheduling and provide ongoing rr*anagement of the program. As a 
standard format, each course consisted of 20 hours of classroom training offered in five week 
sessions (one partner requested 20 hour ten week sessions). Eight instructors provided the two 
sessions of training held at each company: 70 sections of classroom instruction held on all three 
shifts. Both Mathematics I & II and Communications i & II were offered at each company. 

In addition to the group instruction, facilitated learning lab sessions were held in the multi-media 
learning centers at each of the company sites. These sessions were scheduled outside of regular 
class time, were conducted by the instructors and were for the most part voluntary for employees, 
except at one company where the sessions were mandatory. 

Use of the learning centers was sporadic due to work responsibilities. Though the learning centers 
were open and available to participants twenty-four (24) hours a day, most participants used the 
center during the hours which included instructor facilitation. 

The self-paced instruction interfaced effectively v 'h the stand up instruction. Self-paced programs 
and objectives, even though generic in nature, were aligned with objectives for the group 
instruction. When participants were experiencing difficulty, instructors were able to assist them in 
the self-paced environment. 

K. CONDUCT EVALUATION ACTIVITIES 

Evaluations were filled out by each participant at the completion of each course. Results and 
participant comments were summarized. Copies of the evaluation reports for each company are 
included in Attachment F. 

In addition, follow-up TABE results, WES forms and TALS tests were given at the end of delivery. 
The resutr of the before and after assessments are being tabulated by FLW Associates, the 
externa! evaluator for the project. The final evaluation report prepared by the external evaluated 
is attached in Attachment G. 
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IV. ACCOMPLISHMENTS: RESPONSE TO APPLICATION OBJECTIVES 

OBJECTIVES OUTCOMES 



Identify, recruit, and enroll 302 manufacturing employees from 
manufacturing partner*' organizations. 


► 320 employees were identified, recruited, enrolled and 

trained as part of the Results-Oriented Workplace Literacy 
Project 


Design a customized results-oriented workplace literacy program 
based on mutually agreed upon context, Input, process and 
product criteria. 


► Context, Input, process, and product questions were used 
throughout the project period to examine and validate the 
program components. 


Utilize a literacy task analysis, employee survey, focus groups, 
participant pre-training survey, and individual diagnostics to define 
clear performance outcomes for each participant. 


► Task analyses were completed on three K>bs at each of two 
companies and at nine jobs at one company. 

► Individ uai advising sessions were heid with each participant 
to define objectives 

► Focus groups were convened at each of the three 
companies 


Provide contextual^ based, process-oriented, applied workplace 
literacy skills programs for 4 area manufacturers that are 
correlated to increasing job accuracy and productivity, higher 
employee retention and promotion and decreased error rates and 
costs. 


► Four programs in mathematics and communications were 
designed, developed, and delivered at each of three 
companies. 

► Productivity indicators were measured before and after the 
training occurred: productivity, scrap and rework, 
absenteeism; decreases in costs could not be measured. 


Utilize traditional and alternative delivery methodologies as 40* 
hour units of instruction, for a duration of ten (10) weeks each. 


► Forty (40) hour units of instruction were provided over a 
period of ten weeks. 

► Traditional group instruction was supplemented by 
individualized instruction provided in a multi-media learning 
center. 


Implement a competency-based evaluation system that measures 
improvement in participant's ability to apply basic skills to the 
performance requirements of job tasks, improvement in job 
attitude and attendance, increases in quantity and quality of work, 
the cost benefit impact of the program on their bottom line. 


► Improvement in job ability to do job, attitude toward job, 
increases in quantity and improvement in quality were 
measured as part of a comprehensive evaluation design. 
Results were inconclusive because'the interval of time was 
not sufficient to measure long term results. 


Establish an Operations/Technical Advisory Committee that will 
provide technical and managerial support. 


► Operations/Advisory committees were established and 
functioned very effectively at all three partner sites. 


Disseminate the results of the project to other manufacturers and 
educational providers focusing on the ease of replicating the 
Results-Oriented Workplace Literacy Model in other parts of the 
country. 


► League for Innovations National Conference, November, 
1993. 

► National Council for Resource Development, national 
conference, November 1993. 

► Forum at UTC - Manufacturing Partner, Educational 
Providers 

► News release about successful implementation of the 
workplace program at Cleveland Wood Products. 

► Distribution of project results and curriculum to Department 
of Education, DNP OVAE, Clearinghouse on Adult Education 
and Literacy,. ERIC Clearinghouse on Adult, Career, and 
Vocational Education, East Central Curriculum Coordination 
Center, and the Ohio Literacy Resource Center 
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INDIVIDUAL PARTNER ACCOMPLISHMENTS/ISSUES 



ZIRCOA, INC. 

The first company involved in the project was Zircoa, Inc., established In 1952. This company, 
employing approximately 150 people, produces ceramic zirconium and silicate products. CCC/UTC 
staff worked with the Plant Manager to implement the project. The Plant Manager selected a team 
of hourly and union individuals to function as the operations/advisory comnrittee and to coordinate 
the project at Zircoa. Though employees at Zircoa had been working in teams, members of the 
training team were very hesitant, especially in the beginning, to contribute freely in meetings when 
management was present. This continued to be true throughout the project delivery. 

1 . Assessrnent P hase 

Initially UTC was to analyze three jobs at each company. At the insistence of Zircoa's Plant 
Manager, CCC/UTC staff analyzed nine positions which proved to be an over-investment 
of time and resources. The plant manager wanted to include a minimum of 100 
employees in the training and did not have enough participation in three jobs alone. 

Assessment was administered to all 150 employees, since at the outset of the program the 
stated intention of management and the team was to train all employees. As the project 
continued, hourly employees participated in the bulk of the basic skills training. 

Results of the TABE assessment indicated that there were some math skill deficits among 
the workforce, but there was a very high communications (English usage) skill level Later 
we learned that this high skill level could be expected at a high technology company such 
as Zircoa. As a result, CCC/UTC staff developed a more advanced Communications 
course that addressed basic verbal communications skills on the job, such as how to deal 
with difficult people; how to listen effectively; and how to express yourself effectively. Role 
playino formed a large part of the course. This course was well received and many of the 
hourly* participants expressed the desire that management level employees would take the 
same training. 

2. Curriculum Design Phase 

The challenge to the curriculum developer was to create jot>related materials that 
represented facets of each of the nine jobs that were analyzed. Overlapping competencies 
among the jobs were determined and course objectives were written for these 
competencies.. In some cases, individuals in specific jobs, were exposed to competencies 
which were not required as part of their jobs. This proved to be a plus to the members 
of the operations/advisory committee who felt that all Zircoa employees could benefit from 
learning what other employees do. After the first round of training, feedback about the 
curricular materials was solicited from both participants and instructors. Curricular 
materials were revised prior to the second round of training. 

3. Delivery Phase 

Because of employee resistance to the program, the introduction of the training program 
at Zircoa was extremely challenging. The situation was further complicated by the internal 
tensions of union and management. The union president was a member of training 
operations/advisory team. However, he was extremely threatened by the basic skills 
training and demonstrated little or no support of the program. Similar feelings were 
subsequently demonstrated by much of the hourly workforce. An analysis of the reasons 
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for these feelings uncovered a perception by employees that the testing/training aspects 
of the program were a means for management to "weed people out." 

To alleviate some of this anxiety, training operations/advisory team meetings were held, 
at the request of the Plant Manager, biweekly during the entire delivery phase. These 
meetings allowed team members to ask questions and advice on dealing with employee 
questions about the program. It also proved to be a forum for employee feedback on the 
program. The *~zm put together a monthly newsletter to inform employees about the 
program before it started. 

Individual advising sessions were conducted by UTC staff to explain assessment scoring, 
interpretation, and results. An in-depth interview of potential participants was conducted 
to secure information on educations! goals, learning style preference, highest level of 
educational achievement, and other pertinent information necessary to complete an 
individual learning plan. In addition, training recommendations were made and commitment 
of participation was sought from each participant. 

Extreme resistance was evident during first two weeks of program delivery. As participants 
continued through subsequent weeks, they felt less threatened and began to participate 
more freely in the classes. By the end of the project delivery there were many positive 
outcomes for the participants. 

The self-paced learning lab was more heavily used at the beginning of the program than 
at the end. Typically some individuals were regular users of the lab and one individual 
chose to go through his math course entirety in the lab's self-paced environment. 

4. Evaluation Phase 

By the end of the first round of training at Zircoa, the training was totally accepted and 
moving forward very effectively. The Zircoa operations/advisory committee continued to 
have problems recognizing the positive aspects of the program. By the end of the second 
round, this was not so much of a concern since much, if not all of the original employee 
anxiety, had dissipated. There were even requests for information on when more training 
would begin. 

5, Follow-Up 

Now that the services provided by the National Workplace Literacy Program have been 
completed, Zircoa has requested and scheduled additional sections of Mathematics II and 
Communications II for all of those who took the first courses under the grant. In addition, 
they have requested Communications III for those in the company who have not had it. 
The Unified Technologies Center has been written into the union contract as the 
educational provider for these courses. 

TRW, INC., VALVE DIVISION 

The second company participating in the grant program was TRW, Inc., Valve Division, an 
automotive supplier of valves which was founded in 1901. The parent company has 100 plants in 
17 countries and manufactures steering and suspension components, occupant restraint systems, 
engine components, electrical-electronic controls, and engineered fasveners. This particular site 
of TRW employees approximately 900 people. This company had a training program (excluding 
basic skills) in place prior to partnering with UTC in the workplace literacy project. Employees were 
accustomed to participating in training programs. Though the attitude toward training was not 
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always positive, there was still less resistance to overcome than at Zircoa. 



1. Assessment Phase 

Job analysis had been performed on the position of Automation Operator at TRW Valve 
and a. pilot group had been assessed and trained prior to partnering with CCC/UTC in the 
workplace literacy grant. Under the grant, Heavy Duty Operators and Inspectors were 
added to the project and job analysis was performed on these positions. 

TABE assessment results indicated basic skills deficits in over 200 employees. One 
hundred fifty-one (151) employees participated in either one or two courses. 
Mathematics and Communications I & II were indicated for a number of participants. 
Individual TABE results and course recommendation meetings were provided for the 
workers who took the TABE. During this phase there was tremendous support from 
management for putting the program in place and test ar.d advising sessions went very 
well. 

2. Curriculum Design Phase 

Mathematics and communications competencies determined in jobs analyzed at TRW 
were similar in many cases to those of the jobs analyzed at Zircoa. As much as possible, 
the curriculum developer used the core materials which existed from the first company and 
integrated job-related materials from the second company. Activities using job-related 
vocabulary and problem solving situations were developed as exercises in all courses. 
After the first round of training, feedback about the curricular materials was solicited from 
both participants and instructors. Curricular materials were revised prior to the second 
round of training. 

3. Delivery Phase 

Due to TRW having other training programs in place and in progress, the delivery schedule 
for the grant training was modified to ten-week sessions, one day of training per week for 
grant participants. During the first round of this phase, management support of the project 
continued to be strong with newsletter reminders of upcoming training and progress reports 
on the training and its purpose in the larger scheme of TRW programs. Prior to the second 
round of training the TRW grant representative opted to take an early retirement offer. In 
addition there were layoffs among the hourly workers. These incidents had an effect on the 
remainder of the grant training: morale plummeted among the employees; there was little 
management support for the program due to TRW not replacing the Human Resource 
functon of the TRW grant representative. Enrolment and participation in the second round 
was lower than in the first round. The self-paced lab was under-utilized. 

4. Evaluation Phase 

In spite of the layoffs and other circumstances at TRW, those participants who stayed with 
the program gave it positive evaluations and found it beneficial to them professionally and 
personally. They also expressed an interest in more training in light of the fact that there 
would be more layoffs. Most employees wanted to get as much as training as pos r? *jle 
before future layoffs. 

5. Follow-Up 
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Though TF(W Valve has not continued the basic skills training with remaining employees, 
it has contracted with CCC/UTC to provide a number of technical and supervisory 
development programs including blueprint reading, teambuilding, and group problem 
solving. 

CLEVELAND WOOD PRODUCTS (CWP) 

CWP was an interesting and different project site: it is a small, non-union company that had no 
experience with formal training programs prior to the workplace literacy program. There was a 
number of non-English speaking personnel. Also, the company uses a large number of temporary 
employees on a semi-permanent basis and some of them participated in the program. There was 
strong management support of the program with the intention of establishing a vehicle for further 
future training. 

CWP established an operations/advisory committee consisting of two hourly workers, two 
supervisors, the Quality Engineer and the CCC/UTC representatives. There was a lot of groundwork 
to be done initially with this group. Over the course of the grant delivery they became a very 
effective vehicle for keeping other employees informed and involved in the grant project. Members 
worked through their own anxieties and assisted other employees by answering questions and 
providing support. Of all the companies, this team was the most effective in keeping employee 
involvement on a positive level. 

1. Assessment Phase 

This was the most difficult phase for CWP, due to the high level of anxiety of employees. 
The TABE was given. Individuals received tests results and recommended courses in the 
mail per the operations/advisory committee request. Individual advising time was offered 
for those who wanted it. 

There was a wide range of basic skill deficiencies at CWP. Communications and 
Mathematics courses had to be adapted to lower levels than at the other companies. 

2. Curriculum Design Phase 

Mathematics and communications competencies determined in jobs analyzed at CWP were 
similar in many cases to those of the jobs analyzed at Zircoa and TRW Valve. However, 
the test results of the employees indicated a much greater need for basic skills in 
mathematics and communications. The courses developed were paced much more slowly 
and covered less material in the twenty hours designated than similar courses at ether 
companies. The curriculum developer used many of the core materials which existed from 
the first and second company and integrated job-related materials from the third company. 
Activities using job-related vocabulary and problem solving situations were developed as 
exercises in all courses. After the first round of training, feedback about the curricular 
materials was solicited from both participants and instructors. Curricular materials were 
revised prior to the second round of training. 

3. Delivery Phase 

The delivery at CWP was the smoothest of the three companies. Reasons include its 
smaller size, relatively non-hostile environment, and continual, positive and strong internal 
management involvement. 
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By the end of the training project, the overall anxiety level had decreased significantly and 
there were many requests for continued training. As a first experience with training, the 
grant project turned out to be very positive for most employees involved. Others still had 
difficulty understanding the relation of the training to their jobs. 



4. Evaluation Phase 

Evaluations were especially positive for the instructors at CWP. A very productive 
relationship between instructors and the employees formed over the grant training period. 
This has been reflected in the request for continued mathematics training for those slower 
classes who did not complete the training during the grant period. The same instructor has 
been requested by CWP for these classes. 

5. Follow-Up 

Cleveland Wood Products has contracted with CCC/UTC to deliver the second half of the 
mathematics program that was started under the grant with the limited English speaking 
employees. CWP is also planning to use CCC/UTC to design and develop a more 
advanced mathematics course for all employees. This course will include familiarity with 
the metric system, metric conversions, and problem solving with metrics. 
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DISSEMINATION ACTIVITIES 



UTC/CCC staff participated in a number of dissemination activities. These included: 

► Presentation of the project activities and results at the National Conference of the 
League for Innovations in November of 1993. 

► Presentation of project activities and results at the National Council fcr Resource 
Development 

► Presentation of project activities, curriculum, and results at national close-out 
conference in Washington D.C. 

► Press release on activities and outcomes of project at Cleveland Wood Products. 

► Forum at UTC - Manufacturing Partner and Educational Providers 

► Videotaping of partner representatives' reactions and results for inclusion in 
CCC/UTC promotional video 

► Mailing of copies of curricular materials and project reports to Department of 
Education, DNP OVAE, the Clearinghouse on Adult Education and Literacy, ERIC 
Clearinghouse on Adult, Career and Vocational Education, and the East Central 
Curriculum Coordination Center. 

► Mailed information in response to approximately 35 requests for information 

EVALUATION ACTIVITIES 

The project was evaluated on several levels. Participants commented on the relevance of the 
course content to their jobs, the methods of instruction, instructors, the facilities, most useful 
information, and least useful information. Comprehensive evaluation reports from each company 
after each round of training are included in Appendix G. 

The project also employed an external evaluation team which analyzed the changes in pre and post 
test scores, productivity, quality, scrap/rework, and absenteeism. This information is contained in 
a comprehensive evaluation report which accompanies this document. 

PRIMARY LESSONS LEARNED 

Assessment Phase 

1 . The assessment of employees proved to be most difficult part of the entire process. Even 
though information meetings were conducted, employees were still very uncomfortable with 
the assessment. 

The use of assessment instruments that are not as academic as the TABE would help to 
ease the process. The development of diagnostic work-related tests to assess and place 
individuals in appropriate levels would take a significant amount of time. However, 
employees would be much more comfortable with an assessment instrument that deals 
with things they are familiar with. Ultimately, there would be less resistance to the entire 
project. 

2. The Test of Applied Literacy Skills (TALS), piloted in one of the partner companies, 
proved to be a more appropriate tool for assessing basic skills. In the future, this 
assessment would be used. Strategies for determining levels of basic skills as they relate 
to specific job, would need to be determined 
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3. In future grants CCC/UTC staff will select companies with demonstrated basic skills 
deficiencies as partners. One of the partner companies where there was not a serious 
basic skills problem required that CCC/UTC staff provide training for a designated number 
of employees in higher level job-related communications. This put an additional strain on 
the curriculum design team and resulted in an additional course being designed to respond 
to the needs of this partoej . 

Job/Task Analysis 

1 . Job/task analysis activities were conducted about six weeks prior to the delivery of training. 
This put a lot of pressure on the curriculum developer to quickly develop course materials. 
A minimum of ten weeks should be allocated to develop course materials after the 
completion of the job/task analysis. 

2. More photographs and videotapes could be taken and integrated into the courses. 

All instructors need to be involved in the job task analysis. In this project, instructors were 
identified, in some cases, after the job/task analysis had already been completed, 
instructors can be much more effective if they are involved in the job/task analysis and 
curriculum development activities. 

Cuniculum Design 

1 . Job-related materials were integrated into the curriculum. Workers agreed that the courses 
related to their jobs but still felt that additional effort could have been made to make them 
entirely job-related. The amount of customization required to do this is almost prohibitive 
in terms of cost and time, but could definitely make the programs more effective. 

2. Many jobs require similar basic skills competencies. A boilerplate format for basic skills 
competencies used in many manufacturing jobs would facilitate the curriculum development 
process. 

3. CCC/UTC staff did not anticipate the number of hours needed to desktop publish and 
prepare training materials. Additional funds are needed to support this in the future. 

Training Delivery 

1. The question of mandatory vs. voluntary surfaced at each of the partner companies. Those 
companies who required workers to participate met with more resistance than those who 
allowed workers the options. However, in many cases, those workers who opted not to 
participate were those most in need of the basic skills training. With the third company, 
and with the experience gained from the first two companies, CCC/UTC staff decided to 
make the program mandatory for the first three sessions after which employees would have 
the option to stay or leave. This proved to be a very successful strategy. Workers agreed 
to participate for at least the first three sessions, and once they were involved in the 
classes, decided to continue in 96% of the cases. The instructors are credited with this 
fine retention rate. 

2. More regular use of the self-paced learning center would have helped low level and limited 
English speaking workers in their group instructional classes. Only one of the three 
companies permitted use of the learning center on work time. Usage at the other two 
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companies was limited to lunch hours and breaks. Only the really committed employees 
used the center on their own time. 



Training Evaluation 



A more systematic plan for gathering the productivity data is required. Data captured prior 
to and after the training existed in formats which were not useful to the evaluation team in 
analyzing changes. Getting the evaluation team involved in the writing of the grant 
proposal would facilitate this. Working more systematically with the partner companies in 
formatting the data appropriately would also help. 

Productivity data needs to be analyzed for a longer period of time after the training is 
completed. A longitudinal study which would isolate more variables and evaluate the 
performance of individuals would provide much more information about the effectiveness 
of the workplace literacy programs. 
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UST OF ATTACHMENTS 



A. Copies of the job task analysis for each of the three partner companies 

B. Examples of test results given to each company 

C. Samples of Individual Learning Plan 

D. Course description and general outline for each course 

E. Samples of Criterion-referenced assessments 

F. Reports compiled from student evaluation forms completed at the end of each 
course 

G. Final evaluation report (by FLW Associates) 
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CLEVELAND WOOD PRODUCTS 
JOB ANALYSIS REPORT: 



WOOD SHOP OPERATOR 
BRUSH SHOP OPERATOR 



Performed on November 24, 1 992 
As part of the 
National Workplace Literacy Program 



by 



The Unified Technologies Center 



CLEVELAND WOOD PRODUCTS 
JOB ANALYSIS REPORT: 



Wood Shop Operator 
and 

Brush Shop Operator 



Overview: 

The Cleveland Wood Products (CWP) job analysis was performed on Wood Shop 
Operator and Floor and Brush Shop Operator positions for the purpose of developing 
a basic skills curriculum under the National Workplace Literacy Program. 

Purpose and Method: 

In order to identify the basic skills used in each of the three jobs selected, the Unified 
Technologies Center staff used the following steps: 

1. Review of documents used on the job for each job category, including 
blueprints, manuals, SOP documentation, charts, forms, etc., for skill levels 
needed to use them. 

2. Identification of critical tasks for each job. These critical tasks for each of the 
job areas were identified by the UTC staff after employee 
observation/interview sessions. 

3. interview employees performing those jobs about what they do and how 
they do their daily tasks. 

4. Observe employees performing their job tasks. 

The information resulting from these steps was used in the development of Mathematics 
and Communications courses customized to the CWP employees in the job categories 
specified. 

Analysis Results 

An Applied Basic Skills Analysis chart for the Wood and Brush Shop areas are attached 
to this report summary. These charts present the applied basic skills associated with the 
critical tasks identified for each job. 
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Analysis Results (Continued) 

The computation and reading comprehension skill levels indicated as a minimum below 
reflect the higher level of charting and procedure documentation that is being introduced 
in these jobs. Not all operators currently do or need to function at these levels; however, 
they would be a logical goal to strive for based on CWP's plans for refining their 
processes and upgrading employee skills. 

It is also important be certain that process documentation is produced at a reading skill 
level that does not exceed the skill level established by CWP. This is a common situation 
companies find themselves in since much standard documentation for equipment and 
machinery is written at a level higher than is useful. 

WOOD SHOP OPERATOR REQUIRED BASIC SKILL LEVELS: 

Minimum Computation Skill Grade Level - 8 
Minimum Reading Skill Grade Level - 8 

BRUSH SHOP OPERATOR REQUIRED BASIC SKILL LEVELS: 

Minimum Computation Skill Grade Level - 8 
Minimum Reading Skill Grade Level - 8 



Interpretation of Basic Skill Levels 

Skill levels are reported in grade-level format as a convenient reference point to traditional 
educational settings and as an aid in development of course materials. When interpreting 
or reporting basic skills analysis results to individuals involved in associated training 
programs, focus is on the specific applied basic skills required for a job rather than on 
a simple grade-level designation in order to minimize association of company training 
programs with traditional educational programs. 
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TRW VALVE DIVISION 
JOB ANALYSIS REPORT: 



HEAVY DUTY MACHINING OPERATOR 
FLOOR & VISUAL INSPECTORS 



Performed on November 11,1 992 
As part of the 
National Workplace Literacy Program 



by 



The Unified Technologies Center 



TRW VALVE DIVISION 
JOB ANALYSIS REPORT: 

Heavy Duty Machine Operator 
and 

Floor and Visual Inspectors 



Overview: 

TRW Valve Division Job analysis was performed on Heavy Duty Machine Operator and 
Floor and Visual Inspector positions for the purpose of developing a basic skills 
curriculum under the National Workplace Literacy Program. In addition to these two jobs, 
the position of Automation Operator had been analyzed for basic skill requirements in 
March 1992. 

A copy of the Automation Operator job task analysis is attached to this current report. 
Information from all three job categories was included in the course programming. 

Purpose and Method: 

In order to. identify the basic skills used in each of the three jobs selected, the Unified 
Technologies Center staff used the following steps: 

1 . Review of documents used on the job for each job category, including 
blueprints, manuals, SOP documentation, charts, forms, etc., for skill levels 
needed to use them. 

2. Identification of critical tasks for each job. These critical tasks for each of the 
job areas were identified by the TRW Valve Division training team prior to 
job analysis and confirmed during analysis by UTC staff. 

3. Interview employees performing those jobs about what they do and how 
they do their daily tasks. 

4. Observe employees performing their job tasks. 

The information resulting from these steps was used in the development of Mathematics 
and Communications courses customized to the TRW Valve Division employees in the job 
categories specified. 
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Analysis Results 

An Applied Basic Skills Analysis chart for the Heavy Duty and Inspection areas are 
attached to this report summary. These charts present the applied basic skills associated 
with the critical tasks identified for each job. 

Some factors to note in the analysis of the Heavy Duty and Inspector functions include: 

► Reading skill levels required for Heavy Duty Machining Operators using 
reflects the level of training they are given and technical resources they 
consult in relation to CNC equipment, for example. 

► Computation skill level for Visual Inspectors would be significantly higher 
(9th grade), if inspectors are included in cross-functional teams and asked 
to perform any SPC charting activities. 

► Required day-to-day reading skill level for Visual Inspectors is at a level of 
8th grade - in their day-to-day job. Visual Inspectors do not read written 
materials. It is important to note, however, that their skill reflects a high 
capacity for and experience with detecting ("reading") subtle visual details. 

► Training of new inspectors is accomplished by one-on-one on-the-job 
training with an experienced inspector. The QCO-122 Visual Inspection 
Standard reference manual is not used. Readability of this manual is 11th 
grade level that may discourage its use. 



HEAVY DUTY MACHINING OPERATOR REQUIRED BASIC SKILL LEVELS: 

Minimum Computation Skill Grade Level - 9 
Minimum Reading Skill Grade Level - 10 

FLOOR INSPECTOR REQUIRED BASIC SKILL LEVELS: 

Minimum Computation Skill Grade Level - 9 
Minimum Reading Skill Grade Level - 1 1 

VISUAL INSPECTOR REQUIRED BASIC SKILL LEVELS: 

Minimum Computation Skill Grade' Level - 6 (9 if SPC charting activities will) 
Minimum Reading Skill Grade Level - 8 (1 1 if referencing current documentation) 
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nterpretation of Basic Skill Levels 



Skill levels are reported in grade-level format as a convenient reference point to traditional 
educational settings and as an aid in development of course materials. When interpreting 
or reporting basic skills analysis results to individuals involved in associated training 
programs, focus i? on the specific applied basic skills required for a job rather than on 
a simple grade-level designation in order to minimize association of company training 
programs with traditional educational programs. 
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JOB ANALYSIS REPORT: 



AUTOMATION OPERATOR 



Performed March 4, 1992 
by 

The Unified Technologies Center 



Cf 



TRW JOB ANALYSIS REPORT 



Purpose and Method 

To determine the basic skill levels required for competant performance of the TRW 
Automation Operator position, job analysis was conducted at the request of TRW on the 
roughing and finishing ends the Atuomation Operator function. Results of the analysis may 
be used as a basis for upgrading skills of current operators; assisting in training of new 
operators; and as a means for standardizing Automation Operator job documentation. 

The job analysis process included the following steps: 

Review of Automation Operator job-related documents, including blueprints, report 
forms, training manual materials, for skills application levels. 

Identification and prioritization of critical tasks performed by Automation Operators. 
This step took place on February 28, 1992 at TRW with a group of Automation 
Operators, supervisors and union representatives working with UTC facilitators. 
Critical tasks were identified by this group as the operator functions of: Reading 
Blueprints, Setting Gages, and Maintaining Set-up for Continuous Run. 

Interviews with and observations of competent performers and their supervisors 
selected by TRW. These sessions took place March 3, 1992. 



Analysis Results 

A detailed list of applied basic skills required for the TRW Automation Operator position 
are presented on the attached Applied Basic Skills Analysis summary sheets. These summary 
sheets connect the applied basic skills of the job to the critical tasks determined by TRW 
at the beginning of the project. 

In addition to the three critical tasks determined by the TRW group (Reading Blueprints, 
Setting Gages, and Maintaining set-up for Continuous Run), UTC has included SPC 
Charting as a critical task of the job and has listed the associated applied basic skills for that 
function of the Automation Operatror position. Although this task is not viewed as critical 
by the operators themselves, it was clear during observations that SPC charting is an integral 
part of their postion. 





Basic computation and reading skill levels determined for competent performance of the 
TRW Automation Operator position are based on the attached Applied Basic Skills Analysis 
summary sheet and on analysis of written documentation associated with the job. 

Computation skills reuired are based primarily on current and possible future SPC charting 
activities. Reading skill level for materials varied widely, from 3rd to 20th grade levels, with 
majority of materials being in the 6th to 14th grade range. A 10th grade level would cover 
the majority of procedures and troubleshooting documents in the Training Guide. 

AUTOMATION OPERATOR APPLIED BASIC SKILL LEVELS 

Minimum computation level required - 8th grade (at current Automation Operator level) 

9th grade (for SPC charting activity 
beyond current levels) 



Minimum reading skill required - 



10th grade 
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ZIRCOA JOB ANALYSIS REPORT 



Overview 

Job analysis took place at Zircoa on nine (9) jobs: BGM Operator, Fine Grain Batch Mixer, 
Grain Plant Operator/Shift Leader, Kiln Operate/Loader, Machinist Class "A," Maintenance 
Tradesworker, Packer Inspector Loader, Press Operator, and Slipcaster/Slipcast Specialist. 

BGM Operator, Maintenance Tradesworker and Packer/Inspector Loader were the three 
jobs that Zircoa wanted UTC to focus on in the analysis as the three most critical jobs in 
their operation. 

Purpose and Method 

Purpose for the job analysis was to determine the basic mathematics and reading skills used 
in each of the jobs. The steps in the process were: 

1. Review documents used on the job for each of the nine jobs, including 
manuals, SOP documentation, charts, forms etc. 

2. Identify critical tasks for each job. 

3. Interview employees in those jobs about what they do in performing their daily 
job tasks. 

4. Observe them performing their job tasks. 
Analysis Results 

The following three critical tasks were identified by Zircoa as applying to all nine jobs that 
were analyzed. All workers should be able to: 

1. To read and understand process documents. 

2. Chart data. 

3. Be prepared for using automation. 

Applied Basic Skills Analysis forms and Summary Analysis Sheets are included for each job 
in this report. The Analysis Forms are detailed lists of computation, reading and 
communication skills for each job. Summary Sheets list the basic computation, reading and 
communication skills and the corresponding grade skill level identified for each job. 



JOB ANALYSIS SUMMARY SHEET 

COMPANY: ZIRCOA 

JOB TITLE: BGM OPERATOR 



BASIC COMPUTATION SKILLS REQUIRED: 

Must be able to: perform whole number operations; use decimals; compute 
percents; perform mixed operations; perform measurement and use in 
calculations; make estimations. 



BASIC READING SKILLS REQUIRED: 

Must be able to: recognize and use task-related words with technical meanings 
or meanings of common abbreviations and acronyms; Identrfy factual detads, 
follow sequential directions; locate information; skim and scan forms; cross- 
reference within and across source materials; use completed forms to locate 
formation to complete a task; compare and contrast information jomtom 
information from multiple sources; select part of « °' 
similarities and differences; determine presence of defe * °;J a ^ 
between relevant and irrelevant information; recognize cause and effect, predict 
outcomes; use charts to sequence events; make inferences. 

BASIC COMMUNICATION SKILLS REQUIRED: 

Must be able to: understand and write process documentation; fill out forms with 
data and comments; communicate verbally with other team members; future use 
of keyboarding skills. 

BASIC SKILL LEVELS REQUIRED FOR ZIRCOA BGM OPERATOR : 

Computational sKill level: 8.9 
Reading/communications skill level: 1 0.0 
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JOB ANALYSIS SUMMARY SHEET 

COMPANY: ZIRCOA 

JOB TITLE: FINE GRAIN BATCH MIXER 



BASIC COMPUTATION SKILLS REQUIRED: 

Must be able to: perform whole number operations; use fractions; use decimals; 
use percents; perform mixed operations; perform measurement and use in 
calculations; make estimations. 



BASIC READING SKILLS REQUIRED: 

Must be able to: recognize and use task-related words w<th technical meanings, 
or meanings of common abbreviations and acronyms; identify factual details; 
follow sequential directions; locate information; cross-reference within and 
across source materials; use completed forms; combine information from 
multiple sources; select part of text or visual materials; identify similarities and 
differences; determine presence of defect or damage; classify or match objects; 
distinguish between relevant and irrelevant information; recognize cause and 
effect; predict outcomes; use charts, diagrams, and schematics; make 
inferences. 



BASIC COMMUNICATION SKILLS REQUIRED: 

Must be able to: understand and write process documentation; fill out forms 
with data and comments; communicate verbally with other team and 
department members; future use of basic keyboarding skills. 



BASIC SKILL LEVELS REQUIRED FOR ZIRCOA FINE GRAIN BATCH MIXER: 

Computational skill level: 8.9 
Reading/communications skill level: 10.7 
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JOB ANALYSIS SUMMARY SHEET 
COMPANY: ZIRCOA 

JOB TITLE: GRAIN PLANT OPERATOR/SHIFT LEADER 



BASIC COMPUTATION SKILLS REQUIRED: 

Must be able to: perform whole number operations; use. decimals; use percents; 
perform mixed operations not including fractions; perform measurements and use 
in calculations; make estimations. 



BASIC READING SKILLS REQUIRED: 

Must be able to: recognize and use task-related words with technical meanings, 
or meanings of common abbreviations and acronyms; identify factual details; 
follow sequential directions; locate information; cross-reference within and across 
source materials; use completed forms; combine information from multiple 
sources; select part of text or visual materials; determine presence of defect or 
damage; distinguish between relevant and irrelevant information; recognize cause 
and effect; predici outcomes; use charts, diagrams, and schematics; make 
inferences. 



BASIC COMMUNICATION SKILLS REQUIRED: 

Must be able to: understand and write process documentation; fill out forms with 
data and comments; communicate verbally with other departments; future use of 
basic key boarding skills. 



BASIC SKILL LEVELS REQUIRED FOR ZIRCOA GRAIN PLANT OPERATOR: 

Computational skill level: 8.9 
Reading/communications skill level: 10.7 
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JOB ANALYSIS SUMMARY SHEET 

COMPANY: ZIRCOA 

JOB TITLE: KILN OPERATOR/LOADER 



BASIC COMPUTATION SKILLS REQUIRED: 

Must be able to: perform whole number operations; read and write decimals; 
compute averages; use calculator; make estimations. 



BASIC READING SKILLS REQUIRED: 

Must be able to: recognize and use task-related words with technical meanings, 
or meanings of common abbreviations and acronyms; identify factual details; 
follow sequential directions; locate information; skim and scan forms; use 
completed forms to locate information to complete a task; compare and contrast 
information ; combine information from multiple sources; select part of text or 
visual materials; identify similarities and differences; distinguish between relevant 
and irrelevant information; recognize cause and effect; predict outcomes; use 
charts to sequence events; identify components within a manual or schematic; 
make inferences and interpret codes and symbols. 



BASIC COMMUNICATION SKILLS REQUIRED: 

Must be able to: understand and write process documentation; fill out forms with 
data and comments; communicate verbally with other team members. 



BASIC SKILL LEVELS REQUIRED FOR ZIRCOA KILN OPERATOR/LOADER : 

Computational skill level: 8.9 
Reading/communications skill level: 8.9 
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JOB ANALYSIS SUMMARY SHEET 

COMPANY: ZIRCOA 

JOB TITLE: MACHINIST CLASS 'A' 



BASIC COMPUTATION SKILLS REQUIRED: 

Must be able to: perform whole number operations; use fractions; use decimals; 
use percents; perform mixed operations; perform measurement and use in 
calculations; make estimations. 

Additional skills required beyond basics: shop geometry and shop trigonometry. 



BASIC READING SKILLS REQUIRED: 

Must be able to: recognize and use task-related words with technical meanings, 
or meanings of common abbreviations and acronyms; identify factual details; 
follow sequential directions; locate information; cross-reference within and 
across source materials; use completed forms; combine information from 
multiple sources; select part of text or visual materials; identify similarities and 
differences; determine presence of defect or damage; classify or match objects; 
* distinguish between relevant and irrelevant information; recognize cause and 
effect; predict outcomes; use charts, diagrams, and schematics; make 
inferences. 



BASIC COMMUNICATION SKILLS REQUIRED: 

Must be able to: understand and write process documentation; fill out forms 
with data and comments; communicate verbally with other team members; use 
basic keyboarding skills. 



BASIC SKILL LEVELS REQUIRED FOR ZIRCOA MACHINIST CLASS 'A': 

Computational skill level: . 8.9 + 

Reading/communications skill level: 9.7 
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JOB ANALYSIS SUMMARY SHEET 
COMPANY: ZIRCOA 

JOB TITLE: MAINTENANCE TRADESWORKER 



BASIC COMPUTATION SKILLS REQUIRED: 

Must be able to: perform whole number operations; use fractions; use decimals; 
perform mixed operations; perform measurement and use in calculations; make 
estimations. 



BASIC READING SKILLS REQUIRED: 

Must be able to: recognize and use task-related words with technical meanings, 
or meanings of common abbreviations and acronyms; identify factual details; 
follow sequential directions; locate information; cross-reference within and across 
source materials; use completed forms; combine information from multiple 
sources; select part of text or visual materials; identify similarities and differences; 
determine presence of defect or damage; classify or match objects; distinguish 
between relevant and irrelevant information; recognize cause and effect; predict 
outcomes; use charts, diagrams, and schematics; make inferences. 



BASIC COMMUNICATION SKILLS REQUIRED: 

Must be able to: understand and write process documentation; fill out forms with 
data and comments; communicate verbally with other team and department 
members; future use of basic keyboarding skills. 



BASIC SKILL LEVELS REQUIRED FOR ZIRCOA MAINTENANCE TRADESWORKER: 

Computational skill level: 8.9 
Reading/communications skill level: 13.2 
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JOB ANALYSIS SUMMARY SHEET 
COMPANY: ZIRCOA 

JOB TITLE: PACKER/INSPECTOR/LOADER 



BASIC COMPUTATION SKILLS REQUIRED: 

Must be able to: perform whole number operations; use fractions; use decimals; 
perform mixed operations; perform measurement and use in calculations; make 
estimations. 



BASIC READING SKILLS REQUIRED: 

Must be able to: recognize and use task-related words with technical meanings, 
or meanings of common abbreviations and acronyms; identify factual details; 
follow sequential directions; locate information; cross-reference within and 
across source materials; use completed forms; combine information from 
multiple sources; select part of text or visual materials; identify similarities and 
differences; determine presence of defect or damage; classify or match objects; 
distinguish between relevant and irrelevant information; recognize cause and 
effect; predict outcomes; use charts, diagrams, and schematics; make 
inferences. 



BASIC COMMUNICATION SKILLS REQUIRED: 

Must be able to: understand and write process documentation; fill out forms 
with data and comments; communicate verbally with other team members; 
future use of basic keyboarding skills. 



BASIC SKILL LEVELS REQUIRED FOR ZIRCOA PACKER/INSPECTOR/LOADER: 

Computational skill level: 8.9 
Reading/communications skill level: 8.8 
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JOB ANALYSIS SUMMARY SHEET 

COMPANY: ZIRCOA 

JOB TITLE: PRESS OPERATOR 



BASIC COMPUTATION SKILLS REQUIRED: 

Must be able to: perform whole number operations; use decimals; perform 
mixed operations; perform measurement and use in calculations; make 
estimations. 



BASIC READING SKILLS REQUIRED: 

Must be able to: recognize and use task-related words with technical meanings, 
or meanings of common abbreviations and acronyms; identify factual details; 
follow sequential directions; locate information; cross-reference within and 
across source materials; use completed forms; combine information from 
multiple sources; select part of text or visual materials; identify similarities and 
differences; determine presence of defect or damage; classify or match objects; 
distinguish between relevant and irrelevant information; recognize cause and 
effect; predict outcomes; use charts, diagrams, and schematics; make 
inferences. 



BASIC COMMUNICATION SKILLS REQUIRED: 

Must be able to: understand and write process documentation; fill out forms 
with data and comments; communicate verbally with other team members; 
future use of basic keyboarding skills. 



BASIC SKILL LEVELS REQUIRED FOR ZIRCOA PRESS OPERATOR: 

Computational skill level: 8.9 
Reading/communications skill level: 10.9 
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JOB ANALYSIS SUMMARY SHEET 
COMPANY: ZIRCOA 

JOB TITLE: SLIPCASTER / SLIPCAST SPECIALIST 



BASIC COMPUTATION SKILLS REQUIRED: 

Must be able to: perform whole number operations; use fractions; use decimals; 
perform mixed operations; perform measurement and use in calculations; make 
estimations; basic algebra. 



BASIC READING SKILLS REQUIRED: 

Must be able to: recognize and use task-related words with technical meanings, 
or meanings of common abbreviations and acronyms; identify factual details; 
follow sequential directions; locate information; skim and scan forms; cross- 
reference within and across source materials; use completed forms to locate 
information to complete a ' task; compare and contrast objects; combine 
information from multiple sources; select part of text or visual materials; identify 
similarities and differences; determine presence of defect or damage; distinguish 
between relevanv and irrelevant information; recognize cause and effect; predict 
outcomes; use charts to sequence events; make inferences. 



BASIC COMMUNICATION SKILLS RECUIRED: 

Must be able to: understand and write process documentation; fill out forms with 
data and comments; communicate verbally with other team members. 



BASIC SKILL LEVELS REQUIRED FOR ZIRCOA SLIP CASTER/SLIP CAST SPECIALIST: 

Computational skill level: 8.9 
Reading/communications skill level: 11.6 
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Continuing Education Program Participant Interview Form 

Individualized Learning Plan 

Q-EASE PRINT THE INFORMATION REQUESTED BELOW 

Date / / 



Name Work Phone 

Last First Company 

S.S. # Work Hours/Shift _ 

Home Address Job Title 

City — Zip Department Name 

Home Phone Supervisor's Name 



HIGHEST GRADE COMPLETED 

□ o-9 □ 10-12 □ H.S. Diploma □ GED □ Some College 

□ Tech Program □ College Degree 



Latest Educational Experience 




What do you hope to achieve by participating in this program? 



LEARNING STYLES, PLEASE RANK BASED ON STUDENT DISCUSSION: 

K 

A 

V 

T 

Low High 
COMPUTER COMFORT LEVEL 1 2 3 4 5 

OTHER INFORMATION 
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ATTACHMENT D 



ERIC 



COURSE TITLE: 



Communications-on-t he-Job I 



COURSE DESCRIPTION: 

This course incorporates job-related documents, forms, charts, and vocabulary 
into the communications process. It begins with learning style definition, study 
skills techniques, and dictionary usage. It develops a job-related vocabulary and 
provides a thorough discussion of the reading process including recalling factual 
information, identifying main ideas, following instructions, and drawing logical 
conclusions. 

TARGET AUDIENCE: 

This course is designed for employees who need to improve their on-the-job 
communications skills. 

PREREQUISITE: 

Third grade reading level 

MAJOR TOPICS: 

o Personal Learning Style 

o Study Skills Techniques 

o Active Listening 

o Dictionary Usage 

o Technical Dictionary Usage 

o Job-Related Vocabulary 

o Phonics 

o The Reading Process 

o Recalling Factual Information 

o Following Instructions 

o Drawing Logical Conclusions 



COURSE LENGTH: 



20 Hours 



SUGGESTED COST: 



$2000/Group (max* group size of ten) 



COURSE TYPE: 



4 



2 




COURSE TITLE: 



Communications-on-the-Job II 



COURSE DESCRIPTION: 

This course incorporates job-related documents, forms, charts, and vocabulary 
into the communications process* It begins with learning style definition, study 
skills techniques, and dictionary usage* It develops a job-related vocabulary and 
provides a thorough discussion of the reading process* Commonly used prefixes 
and suffixes, homophones and homographs, and codes/symbols used in reading 
job-related schematics and blueprints are covered* In-depth analysis of technical 
manuals and job-related documentation. 

TARGET AUDIENCE: 
i 

This course is designed for employees who need to improve their on-the-job 
communications skills* 

PREREQUISITE: 

Fifth grade reading level 

MAJOR TOPICS: 

o Personal Learning Style 

o Study Skills Techniques 

o Active Listening 

o Dictionary Usage 

o Technical Dictionary U»**e 

o Job-Related Vocabulary 

o The Reading Process 

o Homophones/Homographs 

o Common Prefixes and Suffixes 

o Synonyms/Antonyms 

o Codes/Symbols in Schematics/Blueprints 

o Reading Technical Manuals 

o Reading for Meaning 

o Job-Related Memos and Documentation 

COURSE LENGTH: 20 Hours 

SUGGESTED COST: $2000/Group (max* group size often) 



COURSE TYPE: 



4 



COURSE TITLE: 



Mathematics-on-the-Job I 



COURSE DESCRIPTION: 

This course incorporates job-related calculations, processes, and measurement 
along with basic computation enhancement. It begins with a discussion of math 
anxiety and presents techniques for overcoming math anxiety. Basic concepts 
include addition, subtraction, multiplication, and division of whole numbers, with 
an emphasis on solving job-related problems using these operations. It includes 
an introduction to fractions, a comprehensive discussion of decimals, and job- 
related problem solving. 

TARGET AUDIENCE: 

This course is designed for employees who need to improve their on-the-job 
mathematical and computation skills. 

PREREQUISITE: 

Third grade reading level 

MAJOR TOPICS: 

o Whole Numbers 

o Fractions 

o Decimals 

o Conversion of Fractions to Decimals 

o Percents 

o Job-Related Problem Solving 

o Ratio and Proportion 



COURSE LENGTH: 



20 Hours 



SUGGESTED COST: 



$2000/Group (max. group size of ten) 



COURSE TYPE: 



4 



4 
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COURSE TITLE: Mathematics-on-the-Job II 

r 

COURSE DESCRIPTION: 



This course incorporates job-related calculations, processes, and measurement 
along with basic computation enhancement* It begins with a discussion of math 
anxiety and presents techniques for overcoming math anxiety* Basic concepts 
include review of addition, subtraction, multiplication, and division of whole 
numbers, with an emphasis on solving job-related problems using these 
operations. Additional topics include fractions, metric calculations and 
conversions, integers, linear equations. pre-Algebra concepts, solving work- 
related equations, and applying work-related formulas. 

TARGET AUDIENCE: 

This course is designed for employees who need to improve their on-the-job 
mathematical mud computation skills. 

PREREQUISITE: 

Fifth grade reading level 



MAJOR TOPICS: 




c 



o 



o 



o 



o 



o 



o 



o 



o 



o 



Review of Whole Numbers 

Review of Fractions 

Review of Decimals 

Conversion of Fractions to Decimals 

Percents 

Metric Calculations and Conversions 
Job-Related Problem Solving 
Integers 

Linear Equations 
Formulas 

Applying/Solving Job-Related Equations 



COURSE LENGTH: 



20 Hours 



SUGGESTED COST: 



$2000/Group (max. group size often) 



COURSE TYPE: 



4 



ERIC 
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ATTACHMENT E 
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MATHEMATICS ON THE JOB I 
PRE-ASSESSMENT 



I. Write the following as whole numbers: 



A. Four hundred thousand nine hundred eighty-six 



B. Seven million eight hundred twenty-one thousand one hundred thirty-three 



ii. 

A. The mercury on this thermometer B. The dial on this indicator 
reads at the ° F level. points to the number 



This is read as 




III. Add the following numbers: 



A. 415 B. 18,441 
+ 932 59,609 
+ 23,484 



IV. Subtract the following numbers: 



A. 495 
.-23 



B. 88 
- 74 



Solve the following problems: 



What is the total weight - calculated, to be added? 



BATCH NO./ 
DRUM NO. 

< 



4476- 1 



4476-2 



4515-2 



4515-3 



TOTAL WT. 
CALCULATED 



TOTAL WT. 
ACTUAL 



LBS. TO BE 
ADDED 



296 
341 



ACT. WT. 
ADDED 



365 
355 



B. Add the temperature readings for Group 5. 




VI. Multiply the following numbers: 



A. 812 B. 8,421 

x716 x 18 



VII. Divide the following: 

A. 184 + 23 = 



B. 64 | 9245 



ERIC 
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I 



VIII. Solve the following problems: 

A. Last week, 25 drums of A-grain each weighing 55 pounds were produced. 
How many pounds total of A-grain were produced? 



B. Find the average for the temperature readings in Group 11. 




ERIC 
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VIII. 



Solve the following problems: 



A. Last week, 25 drums of A-grain each weighing 55 pounds were produced. 
How many pounds total of A-grain were produced? 



B. Find the average for the temperature readings in Group 1 1 . 



er|c 224 



IX. 



Convert the following: 

A. Write .632 as a percent. 

B. What is the decimal equivalent of 1/4? 



X. Solve the following problem: 



A. GRIND 1.000" DIA. STOCK TO 1-3/8" LGTH 
(REF) 



i 

What would the stock length be expressed as a decimal? 



6 



XI. Add the following decimal numbers: 
A. .836 + 1.59 + 42.64 = 



B. 49.23 + .80 + 7.41 = 



XII. Subtract the following decimal numbers: 



18.449- .671 = 
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B. 8.224 - .55 = 
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XIII. 



Solve the following problems: 

A. Find the upper (+) tolerance of the circled dimension. 




7,988 




7.977 




l-o-l 


1 

1 

1 1 | 


1 

=i ! 


As 

f 2.553 ) 
(^2^467/ 


I 


1 

i 






l-A-l 
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XIV. Multiply the following decimal numbers: 



8.83 x 92.4 = 



B. .855x 1.5 = 




9 



XV. Divide the following decimal numbers. Carry your answers out to 3 decimal 
places. , 



A. 82.4 + .58 = 



B. 77.51 + 8.9 = 



10 
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XVI. Solve the following problems: 



A. You worked 187.75 hours in 2.5 weeks. How many hours did you average 
per week? Carry your answer out to 2 decimal places. 




B. You can earn 2.25 vacation days each month. How many days of vacation 
would you have at the end of 6.5 months. Carry your answer out 3 decimal 
places. 
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XVII. Solve the following word problem. 



A. You're mixing a batch with the following composition: 

ZircoaA.H. 68.8% 
CaC0 3 30.7 % 
MgO .5 % 

The batch is to weigh 1500 grams. How many grams of CaC0 3 do 
you need to add? 




XVIII. Determine the following ratios for the problem given: 

For a fine grain batch, the pounds in is 1423 pounds. The press mix out 
is 1205 pounds. 

A. i What is the ratio of pounds in to press mix out? 



B. Express the ratio found in A as a percent. 



12 
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Solve the following problems: 

A. Determine the unknown number in the proportion: 
6:8 = :24 



B. You are to mix up a solution which is 1 0 parts chemical concentrate and 25 
parts de-ionized water. If you start with 5 liters of de-ionized water, how 
many liters of chemical concentrate will you need to add? 



13 



XX. Add or subtract the following fractions. Reduce your answers to lowest terms. 
A. 9/32 + 15/32 = 



B. 6/5 + 13/16 = 



C. 5/8 - 2/8 = 



D. 4 5/8-1 7/8 = 



XXI. Convert the mixed number below to an improper fraction. 
A. 112/3 = 



XXII. Convert the improper fraction below to a mixed number. 
A. 89/11 = 
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XXIII. Multiply or divide the following fractions. Reduce the answer to lowest terms. 
If the answer is an improper fraction, convert it to a mixed number. 



3/5 x 3/4 = 



B. 7 1/4x9/16 = 



C. 3/5 + 9/20 = 



E. 6 3/4+1 1/2 = 



XXIV. Solve the following problem: 



A chemical concentrate flows into Tank A at the rate of 1 3/4 liters per 
minute. How many liters of chemical concentrate will be in Tank A at the 
end of 5 1/2 minutes? 



15 
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PARTICIPANT EVALUATION SUMMARY 
FIRST ROUND ZIRCOA GRANT DELIVERY 
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PARTICIPANT EVALUATION SUMMARY 

FIRST ROUND ZIRCOA GRANT DELIVERY - November 9 - December 17, 1992 
Overall averages for Evaluation Form responses from 9 first round classes. 
COURSE EXPECTATIONS: 

87% agreed the course content met their expectations. 

83% agreed that they had the necessary skills and knowledge necessary to take 
courses. 

73% agreed that the amount of time allotted for courses was adequate. 
COURSE CONTENT: 

82% agreed that courses would help them do their jobs more effectively. 
82% agreed that courses had practical application to their jobs. 
100% rated their overall impression of courses as high. 
88 % agreed that course objectives were clearly stated. 
88% agreed that stated course objectives were met. 

METHODS OF INSTRUCTION: 

92% agreed there were sufficient exercises/practice with new skills and concepts. 

81% rated instructional materials (textbook/workbook, syllabus/outline, and audio- 
visual aids) most helpful. 

89% rated instructional methods/aids (text, lecture, exercises, discussions, Q&A, 
and videotapes) most helpful. 

78% rated computer-based training helpful. 

72% agreed that materials were well organized. 

INSTRUCTORS: 

88% rated instructors excellent on organization and preparation, master of subject 
matter, ability to make participants feel welcomed and at ease, willingness to 
answer questions, and the ability to communicate subject matter tot he 
participants. 

95% indicated they would take another course with their instructor. 
FACILITIES: 

82% rated the quality of the training rooms as very good or excellent. 
93% agreed that the necessary supplies were available to them. 
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COMPLETE PARTICIPANT WRITTEN COMMENTS: 



Most useful information presented: 

"Every facet of this course can be classified as most useful/ 
"Review of things I learned 25 years ago." 
"How to listen." 

"The effect of one's comment, actions, etc., on other people." 
"Handling difficult people and the Going Nowhere Cycle." 
"Overall help in batching." 
"Example prob!em[s] along with charts." 

"Being a machinist, my world revolves around numbers and various applications (i.e. math, 
Trig, Geometry etc etc) of them. So every facet of this course can be classified as 'most 
usefult.]' 

"Metrics!.] Addting] and subtracting fractions." 
"Fractions & metrics" 
"Temp, changing" 

"Not enough time, classroom for material [sic]" 

"The word that we had to give the meaning to that were job related [sic]." 
"The phonics was most useful." 
"Learning to [sic]" 
"all useful" 

"in general, all was helpful to recall information long ago learned." 

"It helpted] me understand much better!;] also it helpled] me to help my kids in algebra." 

"Fractions." 

"Will help in batching." 

"Everything." 

"Algebra and the metric system helpled] me out a lot. 
"Fractions." 

"Good instrust [sic] & Instructor." 

"Way of communicating - vocal & body language." 

"How to become a more empathetic listener." 

"How to listen." (another participant) 

"How to listen." (another participant) 

"Probably understanding ourselves." 

"Understanding different behavior patterns and why they happen." 
"The different levels of listening." 

"To review math skills that I haven't reviewed or remembered for 20 years." 

"It made me more aware of being an empathetical [sic] listener. It gave me some ideal [sic] on 

how listening can work for me." 

"Handling difficult people and the "Going Nowhere Cycle." 

"The different behavior modes we tend to be oblivious toward." 

"Listening skills & how to work with others and deep communication open." 

"Text books and video tapes." 

"I didn't know listening is a skill. Now I realize that." 

"Skills." 

"Interest in learning new words such as homophone, proprietary." 

"Fractions and decimals." 

"All information will be very useful for me." 

"Fractions and decimals." (another participant) 

"Spend less time on adding & subtracting." 

"fractional and decimals. "(another participant) 
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Least useful information presented: 
"N/A" 

"Positive and negative numbers" 
"Metric." 

"Names of the behaviors." 

"How to speak." 

"Hopefully metrics." 

"Needed more class time." 

"Fractions are always done on calculator." 

"I think al! the information was necessary." 

"Need more time." 

"Roleplaying." 

"None." 

"None." 

"Does not apply" 
"Algerba [sic]" 

"Not enough time to really learn material!.) everything seemfed] rushedf.]" 

"None." 

"None." 

"everly) time I go to use the computer the Hold Plant Isic] would walk by, and I can't get the 
thim [sic] to work [.] No one was arounglsic] to Help so I just say for get [sic] this mess-" 
"hopefully metrics" 

"Metric system is helpful but it does not applied [sic] to our job." 

"Fractions are always done on calculator." 

"Needed more class time." 

"None." 

"More time." 

"Character roles." 

"How to speak." 

"The names of the behaviors." 

"I think all the information was necessary." 

"None." 

"Need more time." 
"No least useful." 
"Roleplaying." 
"None." 

"Time to[o) short." 

"Time to[o]short." (another participant) 

"The circles." 

"None." 

"The circles." (another participant) 
"The first two sessionls)." 
"Addition and subtraction." 
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Comments about the materials: 

"The videotapes were really bad." 

"I thought the instructor was well-prepared and answered in [a] proper and well-expressed 
manner." 

"Went toto] fast. Really didn't get a whole lot out of this course." 

"Excluding the few mistakes found in the textbook, I feel this course was excellently organized 
and delivered to the students." 

"There were typing errors, spelling & wrong answers." 

"It was a fast pace." 

"There were a lot of mistakes" 

"Not long enough for material cover [sic]." 

"Verry [sic] Good." 

"Hard to remember." 

"Computer-based Training need instructure [sic]." 

"None." 

"None." 

"Better organization of exercises... different levels of participation made the 'role playing' an 
ineffective tool. Could try one set of role players - a little more time to prepare and let balance 
of class observe/comment." 

Comments about instructors: 
"Super." 

"Highly competent instructor and very good natured." 

"Very helpful and easy to understand." 

"I liked small classes so we all can get individual attention." 

"Course was well presented but it was to[o] fast for complete understanding." 

"I felt you did a good job, but you went just a little too fast." 

"Nancy was [a] good instructor." 

"A job very well done!;] beautiful," 

-Oh yea!" 

"i feel Lisa was a very good instructor and very helpful." 

"Course was well presented, but it was toto] fast for complete understanding." 

"Very good ability to teach." 

"Feeling of friendship was there. Easy going attitudes." 

"Good luck." 

"None." 

" Marianne Canario was a wonderful* instructor. 5 and plus. She was excellent." 
"A very good instructor." 

"Marianne was a terrific instructor. Fears from years ago were almost erased & the IS 
something." 
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Comments about the facility: 
"Excellent job, Zircoa." 
"Did not get to the computer lab." 
"Class too large for room." 
"Tables too close." 
"Room too small." 
"Did not get to go." 

"Not enough room/Class was too large." 
"exexe [sic]" 

"Unfortunately, I had no time to use the lab." 
"Would like to take this course at a slower pace." 
"Satisfactory," 
"Thanks." 

"Tables to[o] close." 
"Have fun." 
"None." 
"None." 

"The room was toto] small." 



Additional comments about classes: 

"If the course was 2-4 hours longer over the entirety, would have helped. 
"Thanks." 

"Overall good class and instructor." 

"Enjoyed the class, wish everyone at Zircoa would take this class." 

"Enjoyed it much. Hated to miss some classtes]." 

"Good course, I needed the revue [sic]." 

"Enjoyed it very much. Hated I had to miss some class." 

"Enjoyed the class, wish everyone at Zircoa would take this class." 

"Overall good class and instructor." 

"Good looking out! More, more, more." 

"1 enjoyed the class had a very good instructor [sic]." 

"We had a great instructor." 

"Our instructor was extremely patient and we learned very well with her. 
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PARTICIPANT EVALUATION SUMMARY 
SECOND ROUND ZIRCOA GRANT DELIVERY 

January 18 - February 23, 1993 
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PARTICIPANT EVALUATION SUMMARY 

SECOND ROUND ZIRCOA GRANT DELIVERY - January 18 - February 23, 1993 

Overall averages for Evaluation Form responses from second round classes. 
COURSE EXPECTATIONS: 

75% agreed the course content met their expectations. 

79% agreed that they had the necessary skills and knowledge necessary to take 
courses. 

65% agreed that the amount of time allotted for the courses was adequate. 
COURSE CONTENT: 

73% agreed that courses would help them do their jobs more effectively. 
70% agreed that courses had practical application to their jobs. 
88% rated their overall impression of courses as high. 
83% agreed that course objectives were met. 

METHODS OF INSTRUCTION: 

83% agreed there were sufficient exercises/practice with new skills and concepts. 

85% rated instructional materials (textbook/workbook, syllabus/outline, and audio- 
visual aids) most helpful. 

91% rated instructional methods/aids {text, lecture, exercises, discussions, Q&A, 
and videotapes) most helpful. 

86% rated computer-based training helpful. 

84% agreed that materials were well organized. 

INSTRUCTORS: 

97% rated instructors excellent on organization and preparation, master of subject 
matter, ability to make participants feel welcomed and at ease, willingness to 
answer questions, and the ability to communicate subject matter to the 
participants. 

95% indicated they would take another course with their instructor. 
FACILITIES: 

64% rated the quality of the training rooms as very good, or excellent. 
90% agreed that the necessary supplies were available to them. 
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COMPLETE PARTICIPANT WRITTEN COMMENTS: 



Most useful information presented: 
"Understand your own learning style" 
"Listening and comprehension 
"All were ueeful" 
"AH was useful" 

"Reviewing & "Learning" Learning Skills" 

"How to handle a problem situation effectively" 

"Good listening leads to good communication" 

"What type of verbal and non-verbal messages are you sending" 

"I think the book "Listen In" is very Informative" 

"Definition of the 3 levels of listening" 

"Seeing myself in a situation & now having the knowledge on how to talk my way through it" 
"The whole course" 

"Types of listening - how to be effective listener - barriers to listening" 

"How to go ebout remembering" 

"Blue Print Reading" 

"The ways to read subject matter" 

"Reading speed because one has to know his study and normal speed, es well as when to skim and when to scan" 

"Everything" 

"Use of a dictionary" 

"That It is not necessary to read each word when doing reading" 

"Reading/Notetaking" 

"Notes on how to read better" 

"How to read more effectively, follow instructions and -listening to what you hear." 
"This course emphasized and clarified importance of learning and listening skills" 
"Understanding listening skills and other basic communicating skills" 
"Reading ebility" 

"Reading ability improved - but I still need more practice" 

"The vocabulary part" 

"How to communicate properly" 

"Math" 

"Use of fractions and formulas" 
"Algebra review" 

"The listening gap & the roles people play. {Driver, Analytical, Amiable, & Expressive)." 

"I'm OK, your OK" 

"Be compassionate yet amiable" 

"Levels of Listening & Attitude Modes" 

"An scientific way to approach communicating with others and a simplified method to check why sometimes we communicate 
with others and a simplified method to check why sometimes we communicate effectively and other times not" 
"The three levels of communication" 

"Recognizing bad listening & realizing how you can improve. How to deal with difficult people. Role playing was effective & 
fun" 

"Understand of listening - being empathetic and resolving conflicts. I am not a particularly good listener." 
"All" 

"Blackboard exercise" 

"Verbal vs listening capability - the gap" 

"How to identify the type of person/listener your dealing with. What type of personality I am." 
"Empathetic listening - considering other's feelings when you present your thoughts." 
"Non verbal communication - transactional analysis" 

"Showed us how we could be listening or not Just by our body language & facial expressions." 
"How to get along with all kinds of people end you can" 
"The lost art of listening" 

"How when you listen or talk to someone its e 50, 50. The speaker is responsible for 50% of communication and the listener 
ts responsible for 50% of communication." 

"Three levels of listening, I'm ok - Your Ok positions. Drama triangle - Techniques for achieving empathic listening - Personal 
styles and how to use them" 

Least useful Information presented: 
"Blueprints" 
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"None" 

"Movie. Very boring" 

"Video on Blueprints " 

"Role play wtt too repetitious " 

"None" 

"Role playing" 

"Length of total time" 

"The role playing (a a waste of time because no significant amount of time is spent critiquing" 
"None come to mind at this moment" 
"Everything was useful" 

"The intro - role playing for me - as I do this daily" 

"None" 

"All useful" 

"No comment" 

"None" 

"For work purposes - general word meanings" 

"N/A* 

"Phonics" 

"Dictionary Skills" 

"Too many dictionary having their own vocabulary" 
"Action & passive reading" 
"Not long enough" 
"Not any" 

"Telling people that they must always use empathic listening - 1 still don't agree" 
"N/A" 

"Empathetic listening. Not because It may not be useful but it just sounds so phony" 
"None" 

"Excessive role playing" 

"N/A" 

"Math" 

"Time allowed not enough" 

"Should have real live examples from work" 

"Bias of communication end body structure" 

"N/A" 

Comments about the materials: 

"The materials seemed to be bits and pieces from various sources that didn't seem to flow together very well." 
"Something you use every day is great" 

"The videotapes were very effective, but all the worksheets that we had to fill out after watching the videos were quite tedious." 
"1 got more from the book than from the practice and discussion" 
"Very Well!" 
"Very Good!" 

"I feel they were proper for this class" 
"More job related. Next time" 
"Like to have more time" 
"This is a well prepared course" 

"1 think the Instructor used good methods for the course." 

"I enjoyed the class, but I feel there should have been more discussion with the class instead of the role playing." 
"Lisa was a very good instructor. She kept the class moving. Wasn't boring at ell" 
"Very good" 

Comments about instructor: 

"In my opinion the Instructor is better suited to teaching more structured ecademic subject such as math. I would prefer to have 
her aa an instructor in that type of subject." 
"Attention getter she is great teacher - interesting" 

"Best aspect wes the ability to elicit class participation - group discussion. She related personal experiences which made the 
class "Real". 

"Had an excellent instructor. Mrs. E." 

"Best UTC instructor at Zircoa. Very personable & presented extra insight that made the course worth while. Good Job. Karen." 
"Instructor gave impression material was good & worthwhile. I've heard other classes comment that their instructor thought 
some exercises were stupid but did them because had to." 
"1 think the instructor makes e big difference" 
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"Very good, wae a pleasure to go to her class" 

"Our Instructor wat vary affective. I think that aha could tell that not everyone wanted to be in class, but her warmth & 
enthusleem made the time bearable" 

"The instructor ahould try not to say "you know" aa often." 

"Instructor waa a very good teacher. Alao taken the time to help you get a better understanding in helping when in need" 

"Instructor waa a vary good teacher. Took the time to help you Qat a better underatanding when in need." 

"The instructor waa really knows the material & know what was to be done correctly." 

"She was OK. I really like Nancy my math teacher. She was really thorough. More expressive." 

"Lisa waa great. Love to have her back." 

"Sometime the instructor let the students take too long covering certain subject." 
"The instructor let to many people ramble on end on." 
"1 appreciate the interest given" 

"She waa well prepared, very nice attitude el ways with a smile." 
"Very Good Job" Thank you - Lisa Notzen" 
"Felt comfortable with instructor" 

"The course was too short, need more time to cover more things." 

"I believe the instructor did a fine job. My only complaint being the course being too long." 
"Lisa did an excellent job in teaching this course. It was very enjoyable." 
"Lisa was a great instructor, she made the class interesting and exciting.** 
"She kept a good pace with the class. She was very helpful." 
"Job well done" 

"I like the way out instructor took time to review past information." 
"Kept the class alive. Seemed to enjoy what she was teaching." 

Comments about the facility: 

"This course was very helpful. But I cannot afford to cut 4 hrs of my workload out 1 need. If the course could be condensed 

to 1-2 hr/wk would be acceptable.'* 

"VCR should be mounted high on wall." 

"Better timing - After hours??" 

"I enjoyed the class and most of all learned." 

"We need more time for class to audio room. ""Very good instructor - not boring." 
"Very helpful" 
"Room too small" 

"I liked being in this class, but I'm a very poor English student." 

"1 like ths review I had last time In math class teacher went over everything of importance before test. We really didn't have 

a thorough review only open for questions." 

"To make many peopld In class. Need better lighting". 

"The room was cold" 

"The facility was ok, had necessary supplies." 

"We should have been given a dictionary, as part of the course supplies." 
"Need more supplies/books, worksheets" 
"My problem, I needed more time." 

"Suggest this course & teacher for all employees at Zircoa." 
"Enjoyed class & instructor" 

"I enjoyed the course & think it will help me in my job & private life. Thank You" 

"It was a little warm at times but sveryone agreed on temp, thermostat adjustment." 

"Room was sither too hot (stuffy^ or cool" 

"Was very cold most of the time" 

"Very helpful with good atmosphere" 

"Room from very warm to cool" 

Additional comments about classes: 
"Teacher did a job well done "A-OK" 
"I believe that the allocated time could be cut in half." 

"It was more than adequate - there was too little material spread over too long a time." 
"None" 

"The course wac* much hslp to ms." 
"Long course timo would have been great ." 
"Need more time did finish sections 9 & 10." 
"I fsal course could drastically be shortened." 

"2 hours/week was too much time to give up from my week. I enjoyed the course but couldn't spend that much time, can it 
be condensed to 1-2 hr/week?" 
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PARTICIPANT EVALUATION SUMMARY 
CLEVELAND WOOD PRODUCTS GRANT DELIVERY 

April 19 - June 30, 1993 
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PARTICIPANT EVALUATION SUMMARY 

CLEVELAND WOOD PRODUCTS GRANT DELIVERY - April 19 - June 30, 1993 

Overall averages for Evaluation Form responses from grant classes. 
COURSE EXPECTATIONS: 

93% agreed the course content met their expectations. 

93% agreed that they had the necessary skills and knowledge necessary to take 
courses. 

75% agreed that the amount of time allotted for the courses was adequate. 
COURSE CONTENT: 

79% agreed that courses would help them do their jobs more effectively. 
77% agreed that courses had practical application to their jobs. 
90% rated their overall impression of courses as high. 
94% agreed that course objectives were met. 

METHODS OF INSTRUCTION: 

97% agreed there were sufficient exercises/practice with new skills and concepts. 

98% rated instructional materials (textbook/workbook, syllabus/outline, and audio- 
visual aids) most helpful. 

88% rated instructional methods/aids (text, lecture, exercises, discussions, Q&A, 
and videotapes) most helpful. 

80% rated computer-based training helpful. 

94% agreed that materials were well organized. 

INSTRUCTORS: 

92% rated instructors excellent on organization and preparation, master of subject 
matter, ability to make participants feel welcomed and at ease, willingness to 
answer questions, and the ability to communicate subject matter to the 
participants. 

100% indicated they would take another course with their instructor. 

FACILITIES: 

81 % rated the quality of the training rooms as very good or excellent. 
97% agreed that the necessary supplies were available to them. 
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SELECTED PARTICIPANT WRITTEN COMMENTS: 



Most ueeful Informetion preeented: 

"Words I ween't aura •bout." 
"AH k useful." 

"...did • good job. But I don't eee what eny of this hee to do with our job." 

"Fraction*." 

"Leeming dedmets." 

"Everything! Fantaatic!" 

"Tha word prob la ma relettng to my job." 

"Gauga raadinga." 

"Only akida + ctn + daily production and man hours." 

"How to communicate by listening end epeaking." 

"Trying to rephraee your comments using en l-meeeage epproach." 

"1 leerned there Is mors thsn one way to learn eomething. 

"Nona." 

Least useful information preeented: 

"Simple sddition." 
"Reducing fractione." 
"Story problems." 
"Ratios." 

"Tha computer beceuee of time." 

"Not enough time to prectlce information preeented." 

"All." 

"At timee it wae juet too easy." 
C omments about the materials: 

"Too many error* on workeh«eU, graphs. Dial* misieeding/not very clear." 

"Who every Isic} wrots Nsncy's book did not proofrsad it- s lot of mistakss in her book." 

"Wss not job-rslstsd enough." 

"Nssdsd mors time on eectione." 

Commente about instructor: 

"I g* her a 10 + !" 

"A very nice person snd a vary good tsacher." 
"Excellent inetructor. A pleesure to meet end work with." 
"Uked the inetructor." 
"She mede the claee enjoyable." 

Commente ebout the facility: 

"Room too hot!" 

"Room emell for both leb end cJeesroom." 

"Not enough room to work et computers comfortably and too noisy." 

"Not enough computer time." 

"Need eeparete room for computer leb time." 

Additionel commente ebout claeeee: 

"I learned e lot coneidering the time we had." 

"I feel much better ebout decimele, euch ee division." 

"Too much meteriel to remember." 

"Overelt e very rewerding end educational experience." 

"Need more time; trying to crem too much into couree." 

"Allowing food end drinke would heve been nice." 

"I enjoyed thle cleee very much. It wee fun." 

"Coiirss wss not rsslly whst I expected." 
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CLEVELAND WOOD PRODUCTS 



COMMUNICATIONS ON THE JOB I 



A pril 19. 1993 - Mav 2L 1993 



Instructor: Marianne Canario 
Sections Number: 30400/30401 



Mav 23. 1993 
No. of Participants: 14 



Note: These two sections of Conmunications I were vastly different in make-up: one was 
a class of individuals who had not had the opportunity for skills enhancement in the 
past. Although their reading levels were fairly low, their verbal communication skill! 
were adequate for the purposes of the class. The other class was almost exclusively 
those with limited English proficiency, in some cases due to the fact that their native 
lan^age was other than English. 

I do not feel confident that the Limited English Proficiency (LEP) group really 
understood how to mark the evaluation form. For example, in some cases two 
numbers were circled for each question, and in every case participants marked 5 all 
the way down the page. Therefore, I have only tabulated those responses from the 
first class. I have , however, included the written comments generated by the second 
group in this evaluation. 



COURSE EXPECTATIONS: 

100% agreed that the course content met their expectations. 

100% agreed that they had the necessary skills and knowledge to take the course. 

100% agreed that the amount of time allotted for the course was adequate. 



COURSE CONTENT: 

100% agreed that the course will help them do their job more effectively. 

100% agreed that the course had practical application to their job. 

100% of participants rated this course very good or excellent. 

100% agreed that the objectives of the course were clearly stated. 

100% agreed that the course met the stated objectives. 

Comments on most useful information presented: 



Comments: 



- I've learned a lot considering the time we had. 



- Words I wasn't sure about (2 times) 

- Our teacher (2 times) 
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Comments on least useful information presented: 

- Doing the alphabet. 



METHODS OF INSTRUCTION: 

100% agreed that there were sufficient exercises and practice with new 
skills/concepts. 

100% rated all the instructional materials and classwork helpful. 
Comments: 

- I enjoyed being in Communications I and having Marianne as a teacher. 



INSTRUCTOR: 

100% rated the instructor excellent in every category. 

100% would definitely take another course with this instructor. 

Comments: 

- I think Marianne was a great instructor, and I hate that I can't have her for 
my math teacher. 

- I give her a 10 + !! 

- Very good at getting her viewpoint over to us. 

- Very nice teacher 

- I enjoyed the class with Marianne. 

- I loved her. 

- Lovely class. I like Marianne very much, 

- Very nice person, very nice teacher. I would like to have more classes with 
you. 

- A very nice person and Very good teacher. 

- I like you, 

FACILITIES: 

83% felt the training room was adequate. 

100% felt necessary supplies were available to them. 

Comments: 

- Room too hot ! (2 times) 

- Room small for both lab and classroom. 
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INSTRUCTOR COMMENTS: 



There was considerable resistance in both groups to the idea of taking classes. 
Consequently, activities were purposely structured to relieve the stress of the situation and to 
enhance participants' confidence in their own learning abilities. Many concepts were first 
presented with games or exercises, and then "de-briefed" to ensure that participants could 
transfer the learning to their situations. This approach was highly effective with these two 
groups, particularly because their reading levels were quite low; considerable frustration 
would have ensued from a strict follow-the-book approach. 

I feel that there was marked success in both anxiety-relieving and confidence. This was 
evidenced by the pre- and post-test scores: pre-test scores (for the combined classes) ranged 
from a low of 29% to a high of 72%. Only five weeks later, however, post-test scores 
ranged from 79% - 96% - including the members of the Limited English Proficiency 
class!! Average improvement was 35% from pre-test to post-test. 

Although progress was slower with the LEP participants, their success was much more 
noticeable; their pre-test scores were lower and consequently, they showed a greater 
improvement on the post-test. Pre-test scores for this group alone ranged from 29% to 
53%; by the post-test, scores ranged from 80% to 96% !! The average improvement for 
this class was 43%. 

Another evidence of the improvement was in the attitudes shown by the participants. Many 
were very .reluctant to enter a classroom again. By the end of this five-week session, every 
participant in both these classes was asking when the next session would be, and what classes 
would be offered after that session. 

I particularly enjoyed working with these two classes. It was a constant challenge to present 
the material in a way which would not require much reading. However, I was able to build 
rapport with the participants, to the point that every one of them commented to me that they 
wanted to take their next class with me also. 
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CLEVELAND WOOD PRODUCTS 



MATHEMATICS-ON-THE- JOB I 
April 20, 1993 - May 20, 1993 

EVALUATION SUMMARY 



Instructor: Nancy Hoffstadt 



Date: May 24, 1993 



COURSE EXPECTATIONS: 

96.7% agreed that the course content met their 
expect at i ons . 

86.7% agreed that they had the necessary skills and 
knowl edge necessary to take the course. 

76.7% agreed that the amount of time allotted for the 
course was adequate. 



COURSE CONTENT: 

63.3% agreed that this course will help them do their job 

mo re effectively. 
73.3% agreed that this course has practical application to 

the i r j ob . 

93.3% rated their overall impression of this course high. 
96.7% agreed that the objectives of this course were 

clearly stated. 
93.3% agreed that the course met the stated objectives. 

Participant comments on the most useful information 
presented in this course are as follows: 

* "All is useful." 

* "Nancy did very good job. But I don't see 

what any of this has to do with our job." 

* "Reading dials, gauges, rulers" responses) 

* "Fractions" 

* "Learning decimal s" 

* "Everything ! Fantast i c ! " 

Participant comments on the least useful information 
presented in this course include: 

* "Simple addition" 

* "Reducing f r act ions" 

* "Story problems" 



METHODS OF INSTRUCTION: 

96.7% agreed that there were sufficient exercises/practice 

with new skills and concepts. 
86.7% rated instru tional materials ( t ex t /workbook , sylla- 
bus/outline, and computer-based training) helpful. 
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76.7% rated the text instructional aid helpful. 
93.3% rated the lecture, exercises, class discussion/ 

question and answer helpful. 
83.3% agreed that the materials were well organized. 

Par t i ci pants 1 comments include the foil owing: 

* "I do fill (sp) that class should have been a 

little longer . " 

* "Too many errors on worksheets, graphs. Dials 

mis leading/not very clear." 

* "Who every (sp) wrote Nancy's book did not 

proofread it--a lot of mistakes in her book." 



INSTRUCTOR: 

100.0% rated the instructor excellent on organization and 
preparation, mastery of subject matter, ability to 
make participants to feel welcomed and at ease , 
willingness to answer questions, and the ability to 
communicate the subject matter to the part ici pants . 

100.0% indicated they would take another course with this 
instructor . 

Participant comments on the instructor include: 

* "Excellent instructor. A pleasure to meet 

and work wi th . " 

* "Very good instructor, we 11 prepared , made 

the class interesting." 

* "I would take more [classes], but I think it 

should be on things we have problems on like 
fractions in stand (sp) of + and - items." 

* "Nancy was excellent I found out firstly 

(sp) how much I didn't know and remember. 
She was so very helpful to us." 

* "Nancy delivereds (sp) inf ormat ion very 

wel 1 . " 

* "Very nice lady and a good and pat i ent 

teacher . " 

* "She was very helpfull (sp) and exspaind (sp) 

everything in detail. 

* "She was very clear on what to do and how to 

do it." 

* "Our instructor delivered inf ormat ion very 

well. She helped me understand alot of 
problems I had some misunderstanding on. " 
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FACILITIES: 



86.7% rated the quality of the training room very good or 
excel 1 ent . 

96.7% agreed that the necessary supplies were available to 
them. 

Participants' comments included the following: 

* "I feel much better about decimals, such as 

division." 

* "Not enough room to work at computers 

comf or tably and too noisy . " 

* "Enjoyed the class." 



INSTRUCTOR COMMENTS: 

Thirty-one participants were administered a pr e-assessment on 
their first day of the course and a post-assessment on their last 
day. Every participant showed improvement by the end of the 
course, The average pre-assessment score was 43%. The average 
post-assessment score was 66%--a significant improvement of 23%, 
Individual scores increased from a low of 6 to a high of 43 per- 
centage points. Many participants expressed their surprise and 
pleasure that they improved their math skill in such a short 
time. Others indicated that they are now ready to learn; during 
their years of formal schooling, they were not as interested in 
1 earning . 

Attendance was above average. Class participation varied with 
the time of day, supervisor/subordinate present in same class, 
and topic of discussion. Skepticism of training program ran 
high, at first. This skepticism showed in their reaction to 
identifying errors, omissions, inconsistencies in course 
materials. Several participants were delighted whenever they 
were the first to recognize an undetected error--at times I felt 
that they were keeping score! To help alleviate this problem, 
after Sessions 5 and 10, I shared with UTC staff member proposed 
changes to make prior to second printing of course. An "ideal" 
arrangement would be to have all materials proofread by 
instructor or other interested party pr ior to reproduction, but 
time and cost may hinder the implementation of this 
re commend at ion . 



The installation of a ceiling fan in the training room aided the 
comfort level of the participants. It was welcomed addition! 

Two areas receiving the lowest scores on the Evaluation Form are 
discussed below: 
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76.7% agreed that the amount of time allotted for the 
course was adequate . 

Several participants indicated that they were 
insulted by reviewing basic ar i thmet ic- -adding , 
subtracting, multiplication, and division of 
whole numbers. More time, they indicated, should 
have been spent with fractions and decimals. 

To provide participants with exercises in these 
specific areas, I developed and distributed 
worksheets for their off-the-job time and I 
encouraged them to use their computer time to 
explore fractions and decimals in greater depth. 

73.3% agreed that this course has practical application to 
their job. 

Several of the 26.7% who disagreed with this 
statement were disappointed that their TABE score 
placed them in this level of Ma themat i cs-on- the- 
Job. Several felt that if they were tested again, 
their score would be much higher. Now that they 
have successfully passed the Math I course, I am 
convinced that their scores wi 1 1 be higher! 

76.7% rated the text instructional aid helpful. 

The participants' comments and my concerns are 
discussed above. 

The staff members at CWP have been extremely helpful, courteous, 
and very accommodating to see that this Workplace Literacy 
Program runs smoothly. It has been a rewarding experience for me 
to be playing a role in their first basic skills venture. The 
recognition luncheon for student participants was the icing on 
the cake! 
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CLEVELAND WOOD PRODUCTS 

MATHEMATICS -ON -THE -JOB II 
April 20, 1993 - May 20, 1992 

EVALUATION SUMMARY 



Instructor: Nancy Hoffstadt 



Date: May 2k, 1993 



COURSE EXPECTATIONS: 

88.2% agreed that the course content met their expectations, 
88.2% agreed that they had the necessary skills and 

knowledge necessary to take the course. 
58.8% agreed that the amount of time allotted for the course 

was adequate . 

Comments : 

"Too much material to remember" 



COURSE CONTENT: 

58.8% agreed that this course will help them do their job 

moreeffectively. 
76.5% agreed that this course has practical application to 

their job. 

100.0% rated their overall impression of this course high. 
9^.1% agreed that the objectives of this course were clearly 
stated. 

70.6% agreed that the course met the stated objectives. 

Par t icipants 1 comments on the most useful information 
presented in this course was as f ol lows : 

"The word problems relating to my job" (2 responses) 

"Fractions (2 responses) and per cents" 

"All the information was helpful to me . " 

"Solving the problems presented in class" 

"Gauge r ead ings " 

"All was great review." 

"Only skids + ctn + daily production and man hours" 
"Positive and negative numbers" 

Participants' comments on the least useful information 
presented in this course were as follows: 

"Absol ute value" 

M Rat ios" 

"The computer, because of time" 

"Not enough time to practice information presented" 
"Fract ions" 
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Participants' comments on the ieast usefui information 
(continued) : 

"Mui t ipi i cat ion and division of decimai s " 

"The algebra" 



METHODS OF INSTRUCTION: 

88.2% agreed that there were sufficient exercises/practice 
with new skills and concepts. 
100.0% rated the instructional materials (textbook/workbook, 
syllabus/outline, and audio-visual aids) helpful. 
58.8% rated the computer-based training helpful. 
94.1% rated the ins true t ional met hods /a ids (text, lecture, 
exercises, discussions, and Q & A) helpful. 
100.0% agreed that the materials were well organized. 

Par tici pants 1 comments included the foil owing: 
"Was not job-related enough" 
"Needed more time on sections" 

"Would have liked more variety of extra materials 
to do on own time" 



INSTRUCTOR: 



100.0% rated the instructor excellent on organization and 
preparation, mastery of subject matter, ability to 
make participants to feel welcomed and at ease , 
willingness to answer questions, and the ability to 
communicate the subject matter to the participants. 

100.0% indicated they would take another course with this 
instructor . 

Participant comments on the instructor include: 
"Nancy was very helpful with anyone who had 

problems or questions." 
"Liked the instructor" 
"Xcellent" 

"Nancy is very patient and comfortable to be 



around 



FACILITIES: 



94.1% rated the quality of the training room very good or 
excel lent . 

100.0% agreed that the necessary supplies were available to 
them. 
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Par t i c i pants 1 comments on the facilities include: 
"Too warm in room— had difficulty staying awake" 
"Not enough room for computers" (2 responses) 
"Not enough time" (2 responses) 

"Not enough computer time allowed — after kl years 
out of school, this class made me dwell too 
deep into my memory* It gave me a headache/ 

"Not enough computer t ime" "Need separate room 
for computer lab time" 

"Would have liked a little more time to learn and 
absorb material" 

"Overall a very rewarding and educat ionai 
exper i ence" 



INSTRUCTOR COMMENTS: 

Sixteen participants were administered a pre-assessment on their 
first day of the course and a post-assessment on their last day. 
Every participant showed significant improvement by the end of 
the course. The average pre-assessment score was k2.k%. The 
average post-assessment score was 79*0%— a significant 
improvement of 36.6 percentage points. Individual scores 
improved from a low of 6 to a high of 60 percentage points. The 
participant with the highest pre-assessment score (86%) improved 
by the least number of points (6), and the participant with the 
lowest pre-assessment score (17%) improved by the largest number 
of points 60). Many participants were very proud of their 
success and verbally expressed their pleasure and gratitude in 
having the opportunity to participant in this worksite training 
program. ' 

Attendance was well above average. Participants indicated their 
willingness to attend. When an absence did occur, materials were 
presented to the participants upon their return. Other 
participants willingly shared notes with absent class members. 

The individual categories on the Evaluation Form that received 
the lowest scores are discussed below: 

58.8% agreed that the amount of time allotted for the course 
was adequate ♦ 

To absorb and retain information within a five- 
week period, the participants were encouraged to 
review and practice new material. As homework is 
not a requirement of the course, I reviewed the 
prior lesson at each new lesson and used all the 
supplemental appendix problems that were provided 
with many of the lessons. In addition, I 
developed and distributed several handouts for 
those seeking add i t ionai practice. Nine out of 
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sixteen participants used these handouts. 

Some of the participants who indicated that the 
time allotted for the course was less than 
adequate also indicated to me that they wanted to 
stay longer, extend the course, or do more math 
problems because they didn't want to return to 
work. They found math fun--not work! 



58.8% agreed that this course will help them do their job 
more effectively. 

This issue was more of a concern to the 
participants before they got involved in job- 
related word problems, than after. They did 
perk up their interest level once these prob- 
lems surfaced. 



58.8% rated the computer-based training helpful. 

The initial problems associated with the implemen- 
tation of the computer programs are now minimized. 
Sharing time with another, cramped quarters, and 
on-going schedule changes have been eliminated, 
now that there is only one per computer, 
workstations have been spread out, and the 
final schedule is in place in week #2 of the new 
round of classes. 

In addition to the above comments, I found the participants an 
enjoyable group to work with who demonstrated a high level of 
cooperation. Student participation varied with each class, 
depending upon, in part, who their classmates were. Supervisor/ 
subordinate relationships hindered open communication by some. 

This Math II course provided all participants with the 
opportunity to think, to analyze, and to apply their knowledge 
and ability to use numbers effectively. Many participants found 
that the Skills Bank computer program provided them with the 
opportunity to reinforce their classroom learning. 
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INSTRUCTOR; 

71% rated the instructor excellent in every category (average score 4.8 out of 5.0). 
100% would definitely take another course with this instructor. 

Comments: 

No comments. 

FACILITIES: 

86% felt the training room was adequate. 
100% felt necessary supplies were available to them. 

Comments: 

- Allowing drinks and food would have been nice. 
INSTRUCTOR COMMENTS: 

This class seemed to be rather interested in math, but many couldn't, see the relation between 
what we were doing in class and what was required on the job. (In fact, some participants 
insisted that they io not do any math on the job, or that the supervisors do it.) Pre-test 
scores ranged from a low of 21% to a high of 77%; by the post-test, the range was 53% to 
99% ! The average improvement was 28%. 

Given the initial math levels of the participants, I feel that the curriculum progressed much 
too fast. I slowed down considerably in order to have participants feel a sense of 
accomplishment rather than frustration, and was able to cover only five and a half of the nine 
modules provided. 

There was considerable resistance at the beginning of the session to the possibility that the 
participants might be asked to do "homework" outside of class. I went to great pains to 
reassure them that it would never be required, but I might occasionally give them the option 
of doing some outside worksheets. The participants seemed to enjoy the class, and by the 
middle of the five weeks, a few were asking for additional worksheets to practice outside of 
class. Those who did the worksheets showed increased mastery of the material, and this 
comfort was transmitted to other members of the class, many of whom eventually asked for 
extra work. Some members of the class expressed their regret that the class was ending so 
quickly. It seemed that they had just begun to feel comfortable doing math again, and then 
the session ended. Many commented that they would like to continue with math. 
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CLEVELAND WOOD PRODUCTS 



MATHEMATICS ON THE JOB II 



A pril 19. 1993 - Mav 21. 1993 

Instructor: Marianne Canario May 23, 1993 

Sections Number: 30405 No. of Participants: 10 



COURSE EXPECTATIONS: 

100% agreed that the course content met their expectations. 
86% agreed that they had the necessary skills and knowledge to take the course. 
86% agreed that the amount of time allotted for the course was adequate. 

Comments: 

- Need more time; trying to cram too much into course. 

COURSE CONTENT: 

71% agreed that the course will help them do their job more effectively. 

71% agreed that the course had practical application to their job. 

86% of participants rated this course very good or excellent. 

100% agreed that the objectives of the course were clearly stated. 

100% agreed that the course met the stated objectives. 

Comments on most useful information presented: 

- Algebra 

Comments on least useful information presented: 

No comments. 

METHODS OF INSTRUCTION: 

100% agreed that there were sufficient exercises and practice with new 
skills/concepts. 

100% rated all the instructional materials and classwork helpful. 
Comments: 

- I enjoyed being in Communications I and having Marianne as a teacher. 



CLEVELAND WOOD PRODUCTS 
COMMUNICATIONS ON THE JOB II 



Mav 24. 1993 - Tune 30. 1993 



Instructo r: Marianne Canario 
Sections Number: 30502/30503 



June 30. 1993 
No. of Participants: 24 



COURSE EXPECTATIONS: 

96% agreed that the course content met their expectations. 
96% agreed that they had the necessary skills and knowledge to take the course. 
100% agreed that the amount of time allotted for the course was adequate. 

Comments: 



COURSE CONTENT: 

83% agreed that the course will help them do their job more effectively. 
78% agreed that the course had practical application to their job. 
61 % of participants rated this course very good or excellent (another 35% rated it 
satisfactory. 

100% agreed that the objectives of the course were clearly stated. 
100% agreed that the course met the stated objectives. 

Comments on most useful information presented: 

- I though everything we learned was useful. 

- How to communicate by listening and speaking. 

- Trying to rephrase your commens using an I-message approach. 

- How to be more specific when complimenting someone. 

- The other workers and supervisors talking about good and bad work 
situations. 

- I learned there is more than one way to learn something. 

- None. 

Comments on least useful information presented: 



- I enjoyed this class very much. It was fun. 

- Course was not really what I expected. 



- All. 




- At times it was just too easy! 
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METHODS OF INSTRUCTION: 

100% agreed that there were sufficient exercises and practice with new 

skills/concepts. 
100% rated the textbook helpful. 
81% rated the computer-based training helpful. 

Comments: 

No comments. 



INSTRUCTOR: 



65% rated the instructor excellent in every category. 
100% would definitely take another course with this instructor. 

Comments: 

- Marianne made the classes enjoyable, which made anxiety go away. 

- Marianne did a very good job. 

- Good instructor, well prepared. Made the class fun. 

- She made the class very enjoyable. 

FACILITIES: 

95% felt the training room was adequate. 
100% felt necessary supplies were available to them. 

Comments: 

- Room could be a little cooler. 

- Room was stuffy at times but other times it was fine. 

- Room could have been larger. 

INSTRUCTOR COMMENTS: 

These two classes were very enjoyable for me. Participants were not reluctant to participate 
and state their opinions, which allowed for a lively discussion in nearly all class meetings. 
Pre-test scores, as always, were somewhat low, ranging from 37% to 78%. By the end of 
the five weeks, however, several participants earned 100% on their post-test, and the low 
was a much more respectable 70%. Individual score increases ranged from 15% to a very 
high 57%, with the average improvement being 32%. 

Although there was some sentiment that the Communications class was not as useful as the 
math, individuals willingly participated in class activities and discussions. On a CWP- 
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sponsored survey asking whether participants would be interested in taking more classes, and 
which those might be, one individual in my class wrote, "Excellent training, very good 
presentation. Reminds us of areas which we all use but tend to take for granted or forget." 
This seemed to summarize several oral comments I received, about the fact that much of 
good communications skill is common sense and common (not commonly used) courtesy. Of 
the 20 people who responded to the CWP survey, ten asked for a Communications III class. 



CLEVELAND WOOD PRODUCTS 



MATHEMATICS ON THE JOB I 



Mav 24. 1993 - Tune 30. 1993 

Instructor: Marianne Canario June 30, 1993 

Sections Number: 30507 No. of Participant?: 6 



COURSE EXPECTATIONS: 

100% agreed that the course content met their expectations. 

100% agreed that they had the necessary skills and knowledge to take the course. 

0% agreed that the amount of time allotted for the course was adequate. 



Comments: 



No comments. 



COURSE CONTENT: 

agreed that the course will help them do their job more effectively, 
agreed that the course had practical application to their job. 
of participants rated this course excellent, 
agreed that the objectives of the course were clearly stated, 
agreed that the course met the stated objectives. 

Comments on most useful information presented: 

- Tolerances (5 times) 

- Use of calculators (4 times) 

- Charts from the floor (3 times) 

- Reading numbers (4 times) 

- Everything 

Comments on least useful information presented: 

No comments. 



100% 
100% 
100% 
100% 
100% 



METHODS OF INSTRUCTION: 

100% agreed that there were sufficient exercises and practice with new 
skills/concepts. 

100% rated all the instructional materials and classwork helpful. 
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Comments: 



No comments. 



INSTRUCTOR; 

100% rated the instructor excellent in every category. 

100% would definitely take another course with this instructor. 

Comments: 

- She's a very good teacher and I like her very much. (2 times) 

- Very nice, a wonderful person 

- Very nice teacher, very nice person. 

- Loved her. 

FACILITIES; 

100% felt the training room was adequate. 

100% felt necessary supplies were available to them. 

Comments: 

- We want another course! (5 times) 
INSTRUCTOR COMMENTS; 

This was a very difficult class to teach, in that virtually all of the participants had had bad 
experiences with math in school. There was a lack of understanding of even the elementary 
concepts of addition, subtraction, multiplication and division. This was evidenced by the 
pre-test scores, which ranged from a low of 28% to a high of 71%. The difficulty was 
further compounded by the fact that several of them spoke English poorly. 

There was also a great diversity of ways to solve problems, given the three cultures 
represented in the room. (Each culture approaches math problems in a different way, and 
even borrowing and carrying were performed in a variety of manners.) Consequently, I 
focussed on the thought processes behind the math problems, as well as on the use of the 
calculator. We concentrated on word problems and charts used on the floor at Cleveland 
Wood, and I feel that great strides were made. 

The progress of the class was quite slow: of the ten modules prepared, this class was able to 
cover only four modules. However, progress during the last two weeks was considerably 
faster than during the first three weeks; I think that once the individuals began thinking 
about math again, some of it came back to them. 



By the end of the five-week session, participants even felt free to point out when I 
(purposely) made mistakes on the board! When asked, they were able to give common-sense 
reasons why my answers were not correct; this was a great enhancer of their self-esteem. 
Participants were amazed at their ability to solve word problems, and all made significant 
progress in their mathematical abilities during the five weeks. The post-test scores were 
significantly better than the pre-test, and ranged from a low of 68% to 84% !! The greatest 
improvements were made by two participants, one of whom improved by 55%, and the other 
improved by 51% ! All participants attempted to do extra problems on the post-test which 
had not been covered in class. To reward this initiative, I gave extra credit points for those 
problems, and the results were amazing: including extra credit, one participant scored 
95%, and all the others scored 100% !! As shown here, the biggest gain in these 
participants was an improved sense of their capabilities, and a willingness to try math 
problems. Participants were just glowing with pride when they received their post-test 
scores. 

This was an extremely rewarding class for me. The greatest challenge was to encourage a 
positive attitude towards math, and to reassure participants that it is all right to make 
mistakes, especially if the logic behind the problem is correct. Without exception, all the 
participants were anxious to continue with the classes, and would like to continue with both 
math and English. I feel that this was a very successful experience for all concerned. 



C1 EVELAND WOOD PRODUCTS 
MATHEMAT I CS -ON-THE-JOB I 

May 25 - June 2k, 1993 

EVALUATION SUMMARY 

Instructor: Nancy Hoffstadt Date: June 2k, 1993 



COURSE EXPECTATIONS: 

100.0% agreed that the course content met their 
expectat i ons . 

100.0% agreed that they had the necessary skills and 
knowledge necessary to take the course, 
80,0% agreed that the amount of time allotted for the 
course was adequate. 



COURSE CONTENT: 

agreed that this course will help them do their job 
mo re effectively. 

agreed that this course has practical application to 
the i r j ob . 

rated their overall impression of this course high, 
agreed that the objectives of this course were 
cl ear ly stated . 

agreed that the course met the stated objectives. 

Participants' comments on the most useful 
information presented in this course were as follows 
* "Every th ing" (2 responses ) 



METHODS OF INSTRUCTION: 

agreed that there were sufficient exercises/practice 
with new skills and concepts. 

rated the instructional materials (textbook/workbook, 
syllabus/outline, audio-visual aids) most helpful, 
rated the computer-based training helpful, 
rated the instructional methods/aids (text, lecture, 
exercises, discussions, and Q & A) most helpful, 
agreed that the materials were well organized, 
rated the instructional methods/aids (text, lecture, 
exercises, discussions, and Q & A^ most helpful. 
Videotapes were not applicable to this course, 
agreed that the materials were well organized. 
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INSTRUCTOR: 



100.0% rated the instructor excellent on organization and 
preparation, mastery of subject matter, ability to 
make participants to feel welcomed and at ease, 
willi ngnesc to answer questions, and the ability to 
communicate the subject matter to the participants. 

100.0% indicated they would take another course with this 
i ns t r uctor . 



FACILITIES 



20.0% rated the quality of the training room very good or 

exce 1 1 ent . . 
80.0% agreed that the necessary supplies were available to 

them. 

Participants 1 comments on the facilities include: 
* "Very hot in training room" (2 responses) 
"Need more air" 
"Afternoon classes verv hot " 



* 
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INSTRUCTOR COMMENTS: 

The Mathematics-on-the-Job I participants appeared to be a 
close-knit group of employees who enjoyed learning together. To 
capitalize on their eagerness to work together, I encouraged 
teamwork and groupwork activities. I did find that there was a 
wide range of speed and ability in solving math problems; 
however, the six participants did not appear to be hindered or 
frustrated by the varying speed or ability levels. 

Participants requested additional worksheets to assist them in 
their math skills. They were all exposed to the Appendix 
problems (which I found very worthwhile and extremely helpful), 
and time was taken during each class to review them. In 
addition, I developed worksheets for homework that I then 
reviewed with them in class. The majority of participants were 
unprepared to review the worksheets, despite their request for 
them. Attendance in the computer lab for the Math I students was 
below average. On several occasions, scheduled students would be 
a "No Show." 

The heat in the afternoons made the training room uncomfortable 
on many occasions. The participants* energy level was greatly 
affected by their lack of comfort. 

All six participants were administered a pr e-assessment on the 
first day of the course and a post-assessment cn the last day. 
Every participant showed improvement by the end of the course. 



2V0 



~3- 



The average pre-assessment score was 37.5%. The average post- 
assessment score was 63.8%--a significant improvement of 26.3%. 
Individual scores improved from a low of 1 to a high of hi 
percentage points. Many participants were very proud of their 
results, as I was of them. The one participant who only 
increased her score by 1 percentage point was absent three 
sessions, and she did not show much interest in taking the time 
to check her work. 

It was my personal goal to encourage the importance of checking 
work and to follow through with each problem from beginning to 
end. Many participants appeared to be in a hurry to get to the 
answer — any answer — and then move on to another problem. 

Attendance was above average. Absentees were provided with 
materials and supplies when they returned to class, and they were 
encouraged to seek help as they made up the work. 

Additional time was used in class to answer individual questions. 
Many participants who had a weak familiarity with word problems 
were encouraged to do the 5-step process for every new problem. 
As they discovered they could be successful, their self-esteem 
increased and they were less timid about trying new problems as 
they progressed through the course. 

This Math I course provided the six participants with the 
opportunity to work together in a learning environment, to think, 
to analyze, and to demonstrate their knowledge and ability to use 
basic math effectively. 
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CLEVELAND WOOD PRODUCTS 
COMMUN I CAT I ON S -ON -THE - JOB II 

May 25 - June 2k , 1993 

EVALUATION SUMMARY 

Instructor: Nancy Hoffstadt Date: July 5, 1993 

COURSE EXPECTATIONS: 

59./*% agreed that the course content met their expectations. 
90.6% agreed that they had the necessary skills and 

knowledge necessary to take the course, 
96.9% agreed that the amount of time allotted for the course 
was adequate* 

Participant comment : 

* I don't think I would have signed up 
voluntar i ly • " 

COURSE CONTENT: 

59.^% agreed that this course will help them do their job 

more effectively. 
56.3% agreed that this course has practical application to 
thei r j ob . 

78.1% rated their overall impression of this course high. 
90.6% agreed that the objectives of this course were clearly 
stated. 

87.5% agread that the course met the stated objectives. 

Participants' comments on the most useful information 
presented in this course was as follows: 

* "How to become a good listener" 

* "It showed me what type of a learner I was," 

* "I like reviewing and learn things I had forgot 
or didn' t know, " 

* "The helping of one to understand better the 
meaning of things, how they are phrased, and 
compr eh ens ion . " 

* "Subject matter about dealing with people," 

* "Def initation (sp) were the most useful infor- 
mat ion*" 

* "Some of the words and meanings of job-related 
things in general , " 

* "Blueprint reading was the best yet least touched 

M 

on . 

* "Getting along with co- workers." 

* "The proper way to abroch (sp) a person or 

subject*" 
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Most useful information (continued) : 

* "Use of proper words when speaking 

peopi e ♦ " 

* "My vocabulary skills*" 

* "All information was useful*" 



to other 



Participants' comments on the least useful information 
presented in this course were as follows: 

* "Instruction about the dictionary" (3 responses) 

* "The meanings of words that do not pertain to my 

job. I don't make the repairs on the machines," 

* "Memo writ ing" 



Reading habits 
'Some of the words 

never heard in 5 

i r r el even t ( sp ) . 

should have been 
"None" 



we were asked to learn I have 
years at CWP I feel are 

There are others that could/ 
us ed ♦ " 



METHODS OF INSTRUCTION: 



93.8% agreed that there were sufficient exercises/practice 

with new skills and concepts* 
93.8% rated the inst ruct iona J materials (textbook/workbook, 

syllabus/outline, and audio-visual aids) helpful. 
81.3% rated the computer-based training helpful. 
93.8% rated the instructional methods/aids (text, lecture, 

exercises, discussions, and Q Ac A) helpful. 
93.8% agreed that the materials were well organized. 



INSTRUCTOR: 



100.0% rated the instructor excellent on organization and 
preparation, mastery of subject matter, ability to 
make participants to feel welcomed and at ease, 
willingness to answer questions, and the ability to 
communicate the subject matter to the participants. 

100.0% indicated they would take another course with this 
instructor . 



Participant comments on the instructor include: 



Excel lent instructor" 

'Nancy was very nice as a person and teacher. 
She has the personally (sp) that makes it 
easy to want to learn more. Very pleasant 
person . " 

'Nancy was very nice and helpful in every way 
needed to teach." 

'It was more enjoyable because of this 
teacher . " 



9 
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FACILITIES: 



8<f.^% rated the quality of the training room very good or 
excel 1 en t ♦ 

96.7% agreed that the necessary supplies were available. 

Participants' comments on the facilities include: 

* "I enjoyed the class and learned a lot." 

* "Room should be bigger--have a few more 

computers to use." 
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INSTRUCTOR COMMENTS: 

Thirty-six participants were administered a pr e-assessment at the 
beginning of the course and thirty-three participants were admin- 
istered a post-assessment on their last day. Two participants 
left the Company prior to the end of the five-week course and one 
participant completed only two weeks of the course. All 
participants who completed the course showed improvement by the 
end of the course. 

The average pre-assessment score was ^5.6%. The average post- 
assessment score was 75.5%---a significant improvement of 29.9 
percentage points. Individual scores improved from a low of 6 to 
a high of 55 percentage points. Many participants were very 
proud of their success and verbally expressed their pleasure and 
gratitude in having the opportunity to participate in this 
worksite training program. 

One supervisor who completed the course expressed how the 
participants 1 self-esteem improved as a result of training. The 
employees have gained more self-confidence. He saw his people 
less resistant to change and more willing to try something new. 

Attendance was well above average. Participants indicated their 
willingness to attend. When an absence did occur, materials were 
presented to the participants upon their return. Other 
participants willingly shared notes with absent class members. 

At times I felt that participants could have benefited from 
additional material. They enjoyed role playing activities. They 
appeared eager for those activities where interaction with class 
members was paramount. Developing dictionary skills was done by 
participants half-heartedly. A variety of learning techniques 
and activities need to be incorporated into course to keep 
interest level high. 

Open communication is hindered by supervisors/managers in same 
class as non-supervisors/ no n -manage rs . 

This course provided participates with an opportunity to "check 
out" and develop their listening, learning, and reading skills. 



PARTICIPANT EVALUATION SUMMARY 
TRW VALVE DIVISION GRANT DELIVERY 

January 26 - June 30, 1993 
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PARTICIPANT EVALUATION SUMMARY 

TRW VALVE DIVISION GRANT DELIVERY - January 26 - June 30, 1993 

Overall averages for Evaluation Form responses from grant classes. 
COURSE EXPECTATIONS: 

89% agreed the course content met their expectations. 

78% agreed that they had the necessary skills and knowledge necessary to take 
courses. 

66% agreed that the amount of time allotted for the courses was adequate. 
COURSE CONTENT: 

77% agreed that courses would help them do their jobs more effectively. 
68% agreed that courses had practical application to their jobs. 
91% rated their overall impression of courses as high. 
89% agreed that course objectives were met. 

METHODS OF INSTRUCTION: 

87% agreed there were sufficient exercises/practice with new skills and concepts.' 

90% rated instructional matemls (textbook/workbook, syllabus/outline, and audio- 
visual aids) most helpful. 

91% rated instructional methods/aids (text, lecture, exercises, discussions, Q&A, 
and videotapes) most helpful. 

64% rated computer-based training helpful. 

91 % agreed that materials were well organized. 

INSTRUCTORS: 

93% rated instructors excellent on organization and preparation, master of subject 
matter, ability to make participants feel welcomed and at ease, willingness to 
answer questions, and the ability to communicate subject matter to the 
participants. 

98% indicated they would take another course with their instructor. 
FACILITIES: 

61 % rated the quality of the training rooms as very good or excellent. 

99% agreed that the necessary supplies were available to them. 

Selected participant comments are included on the attached instructor evaluation 

summary sheets. 
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COMMUNICATIONS ON THE JOB II 



April 13, 1993 - June 22, 1993 



Instructor: Marianne Canario 
Sections Number: 30391/30392 



June 30, 1993 
No* of Participants: 25 



COURSE EXPECTATIONS: 

91% agreed thav the course content met their expectations. 
100% agreed that they had the necessary skills and knowledge to take the course. 
79% agreed that the amount of time allotted for the course was adequate. 

Comments: 



COURSE CONTENT: 

75% agreed lhat the course will help them do their job more effectively. 
74% agreed that the course had practical application to their job. 
t 83% of participants rated this course very good or excellent (another 9% rated it 
satisfactory.) 

100% agreed that the objectives of the course were clearly stated. 
v 96% agreed that the course met the stated objectives. 

Comments on most useful information presented: 

- I learned some definitions regarding my job. 

- The importance of att ; ' ,de and not over-reacting. 

- Knowing what words co use and when to use them. 

- The different ways of reading. 

- Helps you believe in yourself. 

Comments on least useful information prevented: 
No comments. 



- Need more time. 
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METHODS OF INSTRUCTION: 

100% agreed that there were sufficient exercises and practice with new 

skills/concepts. 
100% rated the textbook helpful. 
^,61% rated the computer-based training helpful.** 

Comments: 

No comments. 

** This was an interesting rating, given that none of the 25 participants used 
the computer lab for communications work, to the best of my knowledge. 
This rating may reflect participants' experience with the math programs 
on computer. 



INSTRUCTOR: 

• 43% rated the instructor excellent in every category. 
100% rated the instructor very good or excellent in her ability to make the 

participants feel welcome and at ease. 
100% would definitely take another course with this instructor. 

Comments: 

- The instructor was the best! 

- She made you feel at east and comfortable. 

- I've learned a great deal. 

- Marianne was wonderful; I enjoyed her pleasant personality. 

- She knew the material very well, and was able to convey it; she's a people 
person. 

- Marianne is a good teacher. (2 times) 



FACILITIES: 



74% felt the training room was adequate. 
100% felt necessary supplies were available to them. 

Comments: 

- TRW management/supervisors need a course in Communications (11 times) 

- Extremely cold room, even in cold weather. 

- Cancellation of classes or other necessary data re classes should be posted at 
bottom of stairs — not upstairs. 

- Room always either too hot or too cold. 

- Needed a better dictionary; most of our words we—n't in it. 
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INSTRUCTOR COMMENTS: 



These two sessions of Communications were very interesting for me; participants brought 
their real-life communications problems to class for our discussion, and although there are no 
easy answers, I believe that some of the techniques we discussed may be helpful to them. 
Many participants (11 out of 25) wrote on the evaluations that they believe that TRW 
management and supervisors need to take a course such as this. I agree with them; it is 
often helpful if most of the people in the company share a common vocabulary and 
knowledge of good communication principles. 

The format of these classes was different from that of the other companies we work with, in 
that there is only one class per week. This was sometimes problematic; quite often 
participants forgot to come to class, and occasionally a class member went back down to the 
floor to remind them to come up. There were also quite a few participants who apparently 
dropped out, or never came to even one class. Nevertheless, those who attended on a 
consistent basis seemed to enjoy class and find it useful. As sometimes happens, some 
participants did not see the relationship between the class and their work; approximately 
75% felt that it would help them do their work belter. 

As usual, there was a significant difference between pre-test and post test scores. The range 
of scores on the pre-test was from 42% to 79%. The post-test range was from 80% to 
100%, with several individuals earning the 100%. Average improvement was 36%. 

I feel that some work needs to be done on presenting the vocabulary of the given company. 
It became tiresome to look up words in the dictionary at each class, only to find that very 
few of them were listed, even in the technical dictionary. There were also two occasions 
where participants disagreed about the meaning of words, and since there was no answer 
key, and the words were not listed in the dictionary, I had no way to settle the matter to our 
satisfaction. Most often, when conflicts on definitions arose, I tried to reach consensus 
among the class members, but I don't believe this is as effective as knowing the real 
definition. 

Nearly all of the participants thanked me individually, and said that they had enjoyed the 
class, and found it to be worthwhile. Several asked about future classes, mentioning 
computer and blueprint classes. 
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TRW MATHEMATICS -ON-THE-JOB I 
April lft - June 16, 1993 



EVALUATION SUMMARY 
Instructor: Nancy Hoffstadt Date: June 20, 1993 



COURSE EXPECTATIONS: 

100.0% agreed that the course content met their expectations. 
85.7% agreed that they had the skills and knowledge necessary 

to take the course. 
90.5% agreed that the amount of time allotted for the course 

was adequate . 



COURSE CONTENT: 

95.2% agreed that this course will help them do their job 

more effect ively. 
95.2% agreed that this course has practical application to 

their job. 

v/100.0% rated their overall impression of this course above 
average . 

100.0% agreed that the objectives of thii course were clearly 
stated . 

^100.0% agreed that the course met the stated objectives. 

Participant comments on the most useful information 
presented in this course are as follows: 

* "Decimals, fractions, percents" (2 responses) 

* "Refreshing" 



METHODS OF INSTRUCTION: 

100,0% agreed that there were sufficient exercises/practice 
with new skills and concepts. 
yl'00.0% rated the instructional materials (textbook/workbook, 
syllabus/outline, and audio-visual aids) most helpful. 
^75.0% rated the computer-based training helpful. 
/ 100.0% rated the instructional methods/aids (text, lecture, 
exercises, discussions, Q Ac A, and videotapes) most 
helpful . 

,100.0% agreed that the materials were well organized. 

\/ 

Part icipant comments on the methods of instruct ion 
include the following: 

* "I wish I had more time." 

* "Interesting and vaiueable (sp)." 

* "Not long enough. There needs to be two more 

weeks before you take the test." 
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INSTRUCTOR: 



100*0% rated the instructor excellent c organization and 
preparat ion , mastery of subject matter, ability to 
make part icip ants to feel welcomed and at ease, 
willi ngness to answer questions, and the ability to 
communicate the subject matter to the participants* 

100.0% indicated they would take another course with this 
instructor . 

Participant comments on the instructor include the 
f ol lowing : 

* "Nancy Hoffstadt is very nice and great with 

it 

us . 

* "Took the time to make sure you understood, 

and I need that help." 

* "I had a very good instructor. I had a lot 

of personal problems that interfered." 

* "Precise and understanding . " 



FACILITIES: 

76.2% rated the quality of the training rc^m very good or 
excel 1 ent . 

100.0% agreed that the necessary supplies were available to 
them. 

Participant comments on the facilities include the 
f ol lowing : 

* "Too cool at times" (2 responses) 

* "Yes, everything is O.K. by me." 



INSTRUCTOR COMMENTS: 

The Mathemat ics-on-the~ Job I participants were an enjoyable group 
of individuals to work with. They showed a strong interest in 
increasing their basic math knowledge throughout the 10-week 
course . 

Attendance was above average. Planned vacations accounted for 
the ttl reason why employees missed classes. Frequently, 
employees came to class very tired and lethargic--they indicated 
that overtime hours were frequent and two- day weekends were 
infrequent. Their work schedules prevented many participants 
from devoting personal t;~e to homework or review of prior class 
material, even though many of them wanted and received worksheets 
and review sheets for home use. 

The computer lab was underutilized during this course. On three 
occasions, I accompanied the classes to the lab, demonstrated 
programs, and observed their progress. The majority of students 
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gained familiarity with the Skills Bank and many indicated a 
desire to continue in the lab. However, as no work time was 
allotted for computer usage, the employees participated in the 
lab very infrequently. Throughout the 10-week session, 10 
participants used the computer lab with 1 - k number of visits 
per participant. 

Twenty-four TRW employees began this Math I course. Twenty-one 
participants successfully completed the course. Three 
participants were unsuccessful because of the following reasons: 
1) an extended sick leave, 2) a change in work shift with no 
coverage at worksite to attend class, and 3) a transfer to 
Math II to better accommodate his proficiency level. 

Many of the participants expressed a desire to continue with this 
workplace training. It was evident that their self-esteem showed 
a remarkable increase in maturity as they experienced successes 
throughout the course. 

Ninety-five oercent of the participants showed a gain from their 
pre-test and post-test scores. The one participant who did not 
increase her score was experiencing much stress in her personal 
life at the time of her post-test and "went blank." Following 
the post-test, I talked with her and reviewed the material 
orally. She exhibited a level of math knowledge through this 
oral review that greatly surpassed her score on the written test. 

Pre-test assessment scores ranged from a low of 6/55 = 11% to a 
hi 'h of k\/55 = 75%. Post-assessment scores ranged from a low of 
16/55 = 29% to a high of 51/55 = 93%. Gains ranged from a low of 
2 points to a high of 26.5 points, from a low of 3 percentage 
points to a high of ^8 percentage points. 

Room temperature ranged between very cool to extremely warm on 
any given day. The temperature controls available in the 
training room appeared to be inoperable. 

I found this course to be a rewarding, educational experience- 
both for me and for the participants. The participants were 
challenged to think about, to analyze, and to demonstrate their 
knowledge and ability to work with mathematics effectively. 
Their active participation contributed to their personal and 
educational growth and development. 
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TRW C0MMUNICATI0NS-0N-THE-J08 II 
kpitt 13, 7 993 - Jtute 29, 7993 



EVALUATION SUMMARY 

IrUtnjxcJio^: LUa BoruLccX Daute: JaZy 6, 1993 

COURSE EXPECTATIONS: 

"The coatefvt o4 the coarse met my expecta^t-cort^> 1 

6 5% *tn.o\\gty ctgtee 
3 5 % ag^ee 

"I had the cutd haow£edge aece^a^y -to take t/vU 

7 7% -6t*,oag£y ag^ee 
2 3% ag-tee 

"The cunouuvt oi ttm& aJULott<Ld cqusiAq, cacu6 adequate" 

77% AtsLong&y cug^o. 
2 3% ag-^ee 

Pa>ittctpajvt comments: 
* None 

COURSE CONTENT 

"TlvU> coa^e wttl hoJLp me do my /o6 mo^e <?^4ect^ve£y " 

2 3% >6t^on.g£y ag>^ee 

6 5% ag^ee 

7 2% Atsiongty dt^aug^a. 

"Tht-& catu^c hcu> p*acitca£ app£tcattoa to my job" 

tS% Aisiong&y ag^ee 
n ^ _ 64% ag^ee 
' 18% *£>Longty d<U>agiQ*Q* 

/'"Route, yoiLt ovqsiaJUI tmp^^ton oi tbX* <loll>i<6&" 

40% vety htgh 
60% k-cgh 

"The o 6 / eetcv <2^6 o4 coatee cae^e cXeaiXy stated" 

6 5% <btn.o\xgty ag>Tee 
35% agtee 

"The coauc met the stated 06/ectti/eV 

3 5% AtsLOivgZy ag^ee 
65% ag^ee 




-2- 

COURSE CONTENT ( cojtttnxied ) 

Pa✓^ttctp<uvt comment on mo*6t ius<2^uX XjxiOAjnoXLon 

* "A6oitt Dtc^oriaate^" 

* "How to de^t wtth, dX^idsiztxt po^i^onoJUJ^lo^ In 

job 4<ltuAJ>loru> , e>uijnp£e-po4tttve, ^eed6ac>/' 

* " I/npo-ttance o^ £t-6teatag *6kjJ!JU>" 

* "Tftc dt£ 4 extent u/ay-6 to aom/naatcxLte" 

Pa^^ttctpant conuna/tt-6 oa £ea^t u^>e^uX tn^ oration 
p^te^eated -ca t/vc4 coarse: 

* "Dtcttoita^y iu>eV 
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METHODS OF INSTRUCTION 

"T/te^e, wc^te 4a44tcte.Rt e.x.ei.et^e* and p>tacttce wttit new 
^hXJUU> cutd cortce-ptV' 

46% AtscottgJly ag^ee, 
54% ag^ee 

M Ra.ta tfie, h,e£p4uXae-64 o^ tfte tn^t^cito*ta£ " 
-T&xAbooti/vJoikbook ^eadtng*6 
54% ve^y /te^p^tu^ 
46% /tcXp^uX 

-Stady-gu^de/4y^a6a^/oatitac 
6 0% ve^ty h^eXp^a^ 
40% ZteXp^aX 

-Au4to-vt4aa£ aXd-6 

40% ve^ty h<^tp^uJi 
54% fteXp<cc£ 
6% /tot app£tca6£e 

-Comp LLtosv- bcUi&d tnjaJjMji Q 

12% voLSLy h&lpiuJL 
18% hdJlpiuJl 

2 3% not h,e*£p<a£ 
47% not app£-lca6£e 

"Ra^te. t/te lit^ViULcXlottaJl method* and a^cd^ a-6cd" 
-Te;ct 

^ 40% veiy \%<JlpluJL 

60% fteXp^aC 

6 5% vety /i^p^uX 

3 5% fce^ptfuX 
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METHODS OF INSTRUCTION [ cottttnazd) 



65% vzty KoAp&uJl 
35% KoJlviuJL 

-C£cu>* V^&uUAton/ Question and An^>u)esi 

8 8% vosiy KzJLp^uL-t 

J 2% hoJlp^uJl 

- Vtd&O tap <Z> 

35% vety hoJLp&uJl 

60% heJLpiuJL 

0 5% aot hoXp^at 

" The, maX<iAAMJU> w<isie> mqJJI oi,gcuvlzed" 

70% ^t^onqty ag^ee 
30% ag^ee 

INSTRUCTOR 

"Ra^te tn^tvjLcJLOi on.: 

-O^gajvcza^t-coa cutd pn*<LpasvaAXon 
77% excc^ee/vt 
23% good 

-Ma-6<tety o^ -6a6/eci mcuttzA, 

9 4% -6-ttoag£y ag^ce 
0 6% agtee. 

-AbXJltty to make, pa^tccipartt^ ^ecX welcome and ctt 

94% ax,ce£4eai 
06% good 

- (tiJUULut g a £-6-6 £o cuu>u;e^ qae^6^co/t-6 
9 4% exaeA-fceat 
06% good 

-A6^Lty to commiuvtca£e, ttio, *abjQ*cX mattesi to tli<L 
p anXLo^L p aitt* 

9 4% exceX£eni 
06% good 

"8a-6ed on t/vc-6 expe^U.eace, wouXd yoa -take another 

100% ya-4> 



INSTRUCTOR (continaed) 



Participant dommojvt^ : 

* " Lisa seemed at ease and was very easy to get 
aJLong wii/v. S/ve's an asset to */ve teaching 



FACILITIES 

"Rate ike CiixaJLlty o£ tfo<L t^aMvitvg aoom, i.e., >toom 
appropriate size, adeqaaie -digkiing , kea^t t vQ,nJUZa.tto}t'' 

30% very good 

46% good 

24% no* good 

"Were -the necessary 4ttpp£>ce4 avai£a6<te to yoa?" 
65% strongly agree 
35% agree 

Participant eomme/vt^: 

* "I learned a £ot $or my /o6 aad at /tome." 

* " L}U>tuicXoi very ftetp^a£. Makes one &<lgA at 

case. " 

* "Room too co£d" 



A££ seventeen participants skowed s^cg/tt^tca>vt improvement 
^rom when they took ike pre-a^^essme/tt to token they took ike 
post- ass essrnen*. A££ partXatpa/vts a; ere very proad oi ikeir 
resorts . 

Wine o^ tke seventeen participants wko completed ike coarse 
had perfect attendance. Tke other participants only missed 
one or two classes. 

Many stade/t*6 kave ^ittquU^KLd a6oai daises 4 or ike ^ata^e/ 
AU are interested. 



TRW MATHEMATICS-ON-THE-JOB il 

APRIL 15 - JUNE 24, 1993 
EVALUATION SUMMARY 
instructor: Pamela Jones/Svee-Chin Otley/? Date: July lr 1993 

Section*: 30399 

ClaSS time: 3 :00pm - 5:00pm 
COURSE EXPECTATIONS: 

100% agreed that the course content met their expectations. 
100% agreed that they had the skills and knowledge necessary to take the course. 
33% agreed that the amount of time allotted for the course was adequate. 

COURSE CONTENT: 

67% agreed that this course will help them do their job more effectively. 

67% agreed that this course has practical application to their job. 
- 67% rated their overall impression of this course above average. 

ioo% agrb jd that the objectives of this course were clearly stated. 
v ioo% agreed that the course met the stated objectives. 

Participants comments on the most useful Information presented in this course are as 
follows: 

i 

* No feedback given on evaluations ' 

* One student felt the algebra was very difficult and 
challenging j 
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./ Participants comments on the least useful Information presented in this course are as 

follows: 

* No feedback given on evaluations 



METHODS OF INSTRUCTION: 

t/ 67% agreed that there were sufficient exercises/practice with new skills and concepts. 

v 67% rated the Instructional materials (textbook/workbook, and syllabus/outlines) 
most helpful. 

yioo% rated the computer-based training useful. 

- v 73% rated the Instructional methods and aids most helpful. 

100% agreed that the materials were well organized. 

INSTRUCTOR: 

ioo% rated the instructor excellent on organization and preparation, mastery of subject 
matter, ability to make participants to feel welcomed and at ease, willingness to 
answer questions, and the ability to communicate the subject matter to the 
participants. 

ioo% indicated they would take another course with this instructor. 
FACILITIES: 

67% rated the quality of the training room very good or excellent. 
100% agreed that the necessary supplies were available to them. 
Participants comments on the facilities Include the following: 
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INSTRUCTOR COMMENTS: 

Preassessment MEAN score 26/54 = 48% 
pbst-assessfflent MEAN score 28/54 = 51% 

All participants shoved improvement between Pre and Post-assessment 
scores* 

All participants felt the length of training or instruction should 
have spanned over a longer period of time/ more than an eleven 
veek period. 

Many participants were very interested in additional classes. 



TRW MATHEMATICS-ON-THE-JOB !l 

APRIL 15 - JUNE 24, 1993 
EVALUATION SUMMARY 

Instructor: 'Pamela Jones/Svee-Chin Otley/? Date: J"lY 1 > 1993 

Section #: 30398 

Class time: Is 00pm - 3:00pm 

COURSE EXPECTATIONS: 

40% agreed that the course content met their expectations. 

80% agreed that they had the skills and knowledge necessary to take the course. 

20% agreed that the amount of time allotted for the course was adequate. 

COURSE CONTENT: 

40% agreed that this course will help them do their job more effectively. 
J 20% agreed that this course has practical application to their job. 
* 60% rated their overall Impression of this course above average. 

40% agreed that the objectives of this course were clearly stated. 

20% agreed that the course met the stated objectives. 

Participants comments on the most useful information presented in this course are as 
follows: 

i 

* Taking the time to teach the formulas for each problem 

* The assigned practice homework I 

i 
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Participants comments on the least useful information presented in this course are as 
follows: 

* Too much material to cover in too short of a time period. 

* Felt workbook manual did not have enough and appropriate 
examples of all problems. 

* Being assigned three (3) different instructors made 
learning difficult- 

METHODS OF INSTRUCTION: 

20% agreed that there were sufficient exercises/practice With new skills and concepts. 

60% rated the Instructional materials (textbook/workbook, and syllabus/outlines) 
most helpful. 

60% rated the computer-based training useful. 

44% rated the Instructional methods and aids most helpful. 

. 20% agreed that the materials were well organized. 

INSTRUCTOR: 

76% rated the Instructor excellent on organization and preparation, mastery of subject 
matter, ability to make participants to feel welcomed and at ease, willingness to 
answer questions, and the ability to communicate the subject matter to the 
participants. 

■ 80% indicated they would take another course with this instructor. 
FACILITIES: 

3 oo% rated the quality of the training room very good or excellent. 
ioo% agreed that the necessary supplies were available to them. 
Participants comments on the facilities Include the following: 

* No feedback given on evaluations. 
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INSTRUCTOR COMMENTS: 

Pre-assessment MEAN score 13/54 = 24% 
Post-assessment MEAN score22/54 = 41% 

All participants showed improvement between Pre and Post-assess*e0t 
scores, for the exception of one student's score remaining the 
same. 

All participants felt the length of training or instruction 
should have spanned over a longer period of time r more than 
an eleven week period. 

Many participants were very interested in additional classes* 
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TRW MATHEMATICS-ON-THE-JOB II 
January 29 - April 8, 1993 

EVALUATION SUMMARY 

Instructor: Swee-Chin Otley Date: April 29,1993 

Section #: 30260 

Class time: 3:00pm - 5:00pm 

COURSE EXPECTATIONS: 

60% agreed that the course content met their expectations. 

40% agreed that they had the skills and knowledge necessary to take the course. 

40% agreed that the amount of time allotted for the course was adequate. 

COURSE CONTENT: 

60% agreed that this course will help them do their job more effectively. 
* 20% agreed that this course has practical application to their job. 
✓ 100% rated their overall impression of this course above average. 

80% agreed that the objectives of this course were clearly stated. 
\y 80% agreed that the course met the stated objectives. 

Participants comments on the most useful information presented in this course are as 
follows: 

* "Somebody cares. It was useful." 

Participants comments on the least useful information presented in this course are as 
follows: 

None. 
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METHODS OF INSTRUCTION: 

> 80% agreed that there were sufficient exercises/practice with new skills and 
concepts. 

y 90% rated the instructional materials (textbook/workbook, and syllabus/outlines) 
most helpful. 

v 60% rated the computer-based training useful. 

u 96% rated the instructional methods and aids most helpful. 

1 00% agreed that the materials were well organized. 

INSTRUCTOR: 

100% rated the instructor excellent on organization and preparation, mastery of subject 
matter, ability to make participants to feel welcomed and at ease, willingness to 
answer questions, and the ability to communicate the subject matter to the 
participants. 

1 00% indicated they would take another course with this instructor. 

Participant's comments on the instructor: 

* 'The Instructors were very prepared." 

* "All instructors were professional." 

* "Having 3 different instructors in three weeks was not good." 

* "The instructors really wanted to help," 

FACILITIES: 

40% rated the quality of the training room very good or excellent. 
100% agreed that the necessary supplies were available to them. 



OTHER ADDITIONAL COMMENTS: 



"I would like to take the course again." 

"I'm not sure if I should have started in Math II." 

"I feel Math I would have been better suited to start with." 

"I think everyone shoula start out in Math I. 



INSTRUCTOR COMMENTS: 

All the participants were very cooperative and willing to learn. One partic. >ant dropped 
out, however attendance from the rest of the participants was excellent. 

Pre-assessment scores ranged from a low of 4/54 = 7% to a high if 9/54 = 17%. Post- 
assessment scores ranged from a low of 19/54 = 35% to a high of 47/54 = 87%. All 
participants showed an enormous improvement between their Pre-assessment and Post- 
assessment scores. The improvement scores ranges from a low of 20 percentage points 
to a high of 70 percentage points. 
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TRW MATHEMATICS-ON-THE-JOB I! 
January 29- April 8, 1993 

EVALUATION SUMMARY 

Instructor: Swee-Chin Otley Date: April 29, 1993 

Section #: 30261 

Class time: 5:10pm - 7:10pm 



COURSE EXPECTATIONS: 

100% agreed that the course content met their expectations. 

40% agreed that they had the skills and knowledge necessary to take the course. 

40% agreed that the amount of time allotted for the course was adequate. 



COURSE CONTENT: 

80% agreed that this course will help them do their job more effectively. 
60% agreed that this course has practical application to their job. 
100% rated their overall impression of this course above average. 
100% agreed that the objectives of this course were clearly stated. 
100% agreed that the course met the stated objectives. 

Participants comments on the most useful information presented in this course are as 
follows: 

* "Swee-Chin was very challenging and lot of fun, however unfortunately we don't 
use a lot of Algebra" 

* "Just reminded me what I'm not capable of my Math skills" 



"All" 
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Participants comments on the least useful information presented in this course are as 
follows: 

* "In real life situations and if I knew what to do with it I would excel much better 
(Nancy was really good too). 

* "Please Excuse My Dear Aunt Sally" 
METHODS OF INSTRUCTION: 

100% agreed that there were sufficient exercises/practice with new skills and concepts. 

88% rated the instructional materials (textbook/workbook, and syllabus/outlines) 
most helpful. 

80% rated the computer-based training useful. 

100% rated the instructional methods and aids most helpfu'. 

100% agreed that the materials were well organized. 

INSTRUCTOR: 

100% rated the instructor excellent on organization and preparation, mastery of subject 
matter, ability to make participants to feel welcomed and at ease, willingness to 
answer questions, and the ability to communicate the subject matter to the 
participants. 

1 00% indicated they would take another course with this instructor. 
FACILITIES: 

0% rated the quality of the training room very good or excellent. 
1 00% agreed that the necessary supplies were available to them. 
Participants comments on the facilities include the following: 

* "Heat ventilation were very bad, either too hot or too cold. TRW's problem." 

* "Ice cold room, was sick for 4 days - missed work!!" 

2 
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INSTRUCTOR COMMENTS: 



All the participants were very cooperative and willing to learn. Attendance above average. 

Pre-assessment scores ranged from a low of 10/54 = 26% to a high if 18/54 = 33%. 
Post-assessment scores ranged from a low of 19/54 = 35% to a high of 31/54 = 57%. 
All participants showed an improvement between their Pre-assessment and Post- 
assessment scores. The improvement scores ranges from a low of 9 percentage points 
to a high of 38 percentage points. 
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TRW MATHEMATICS-ON-THE- JOB I! 
January 29 - April 8, 1993 



EVALUATION SUMMARY 
Instructor: Nancy Hoffstadt Date: April 12, 1993 

COURSE EXPECTATIONS: 

97.1% agreed that the course content met their expectations, 
82.9% agreed that they had the skills and knowledge necessary 

to take the course. 
62.9% agreed that the amoun' of time allotted for the course 

was adequate . 

COURSE CONTENT: 

77.1% agreed that this course will help them do their job 
mo re effectively. 
^ 62.9% agreed that this course has practical application to 
their job. 

. 100.0% rated their overall impression of this course above 
average . 

94.3% agreed that the objectives of this course were clearly 
stated. 

100.0% agreed that the course met the stated objectives. 

Participant comments on the most useful information 
presented in this course are as follows: 

* "Positive and negative number s--number line" 

* "Everything" 

* "Fract ions" 

* "Al gebra" 

Participant comments on the least useful information 
presented in this course are as follows: 

* "Temperature conversions" 

* "None" 

* "Too much, too soon" 

* "The course was too jammed — should be stretched 
out --more t ime M 

* "The reading problems" 

* "Little was directly related to job." 



METHODS OF INSTRUCTION: 

v/91.4% agreed that there were sufficient exercises/practice 
with new skills and concepts. 

94.3% rated the instructional materials (textbook/workbook, 
and syllabus/outline) most helpful. 
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77.1% rated the computer-based training helpful. 
v a 91.4% rated the instructional methods and aids most helpful. 
100.0% agreed that the materials were well organized. 



INSTRUCTOR: 



100.0% rated the instructor excellent on organization and 
preparation, mastery of subject matter, ability to 
make pa r t i c i pants to feel wel corned and at ease, 
willingness to answer questions, and the ability to 
communicate the subject matter to the participants. 

100.0% indicated they would take another course with this 
i ns t r uctor . 



FACILITIES 



65.7% rated the quality of the training room very good or 
excel lent . 

100.0% agreed that the necessary supplies were available to 
them . 

Participant comments on the facilities include the 
f o 1 1 ow i ng : 

* "A/C unit not working properly" 

* "Room was too small and too cold" 



INSTRUCTOR COMMENTS: 

Although the Mathemat i cs-on- the- Job II participants were hard- 
working, they were unable to use the computer lab on their own 
time for the additional practice that they needed to develop 
their math skills. They indicated that their work days were very 
long, and many of them had been working seven days a week since 
the beginning of the year. Several of the participants showed an 
interest in extending the course another two weeks to allow them 
computer time to refine their new math skills. 

Attendance was above average. On rare occasions when a class 
member was absent, he or she would obtain class material upon 
return to class . 

Pr e-assessment scores ranged from a low of 7/5** = 13% to a high 
of 28/5^ = 52% Post-assessment scores ranged from a low of 
15/5** = 28% to a high of 50/5** = 93% All participants showed a 
gain between their Pr e-Assessment and Pos t -Assessment scores. 
The gains ranged from a low of 5 points to a high of 31 points, 
from a low of 9 percentage points to a high of 57 percentage 
po ints . 
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Room temperature ranged between very cool to extremely warm on 
any given day. The temperature controls available in the 
training room appeared to be inoperable, TRW management was 
notified of the uncomfortable temeperature conditions in the 
training rooms . 

Overall, I found the course to be a rewarding, educational 
exper i ence — both for me and for the participants. The partici- 
pants were challenged to think about, to analyze, and to demon- 
strate their knowledge and ability to use math effectively on the 
job . 
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TRW COMMUNICATIONS-ON-THE-JOB I 

January 26 - April 6, 1993 



EVALUATION SUMMARY 

Instructor: Lisa Bonacci Date: April 6, 1993 

COURSE EXPECTATIONS: 

"The content of the course met my expectations" 
87.5% strongly agree 
12.5% agree 

"I had the skills and knowledge necessary to take th 
course " 

50 .0% strongly agree 
37 .5% agree 

12.5% strongly disagree 

"The amount of time allotted for course was adequate 
75.0% strongly agree 
12.5% agree 

12.5% strongly disagree 

Participant comments : 

* "Should be longer, more days" 

COURSE CONTENT 

■'This course will help me do my job more effectively 
50.0% strongly agree 
L? 0 . 0 % agree 

"This course has practical application to my job" 
12.5% strongly agree 
87.5% agree 

v "Rate your overall impression of this course '' 

62.5% very high 
37 . S% high 

"The objectives of this course were clearly stated" 
75.0% strongly agree 
25.0% agree 

"The course met the stated objectives" 
, 75.0% strongly agree 

25.0% agree 



COURSE CONTENT (continued) 

Participant comments on most useful information 
presented in this course: 

* "All" 

* "Learning more of the language and how to 

communicate M 

Participant comments on least useful information 
presented in this course: 

* "None" 

METHODS OF INSTRUCTION 

"There were sufficient exercises and practice with 
skills and concepts" 

87.5% strongly agree 
12 .5% agree 

"Rate the helpfulness of the instructional material 
-Textbook/workbook readings 
37.5% vc-y helpful 
12.5% helpful 

-Study-guide/sy ilabus/outline 
87.5% very helpful 
12-5% helpful 

-Audio- visual aids 

100.0% very helpful 

-Computer-based training 

12.5% very helpful 

25.0% helpful 

25.6% not helpful 

37.5% not applicable 

"Rate the instructional methods and aids used" 
-Text 

100.0% very helpful 



-Lecture 

100.0% very helpful 



METHODS OF INSTRUCTION (continued) 
-Exercises 

100. 0% very helpful 

-Class Discussion/Question and Answer 
100. 0% very helpful 

-Videotape 

25.0% very helpful 
50.0% helpful 
12.5% not helpful 
12.5% not applicable 

"The materials were well organized" 

100.0% strongly agree 

Participant comments = 

* "I enjoyed the class because of Lisa, I hope 

that she will continue" 

* five participants said, "Didn't have enough 
time" ( for computer ) 



INSTRUCTOR 

"Rate the instructor on: 

-Organization and preparation 
100. 0% excellent 

-Mastery of subject matter 

100.0% strongly agree 



/ 
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-Ability to make participants feel welcome and at 
ease 

100.0% excellent 

-Willingness to answer questions 
100.0% excellent 

-Ability to communicate the subject matter to the 
participants 

100.0% excellent 

"Based on this experience, would you take another 
course with this instructor?" 

100.0% yes 
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INSTRUCTOR v continued ) 



Participant comments : 

* "Lisa was a very good instructor" 

* "Instructor was very knowledgeable and was 

polite" 

FACILITIES 

"Rate the quality cf the training room, i.e., room of ^ 
appropr iate size , adequate i ighting , heat , vent i la t ion " 

12.5% very good 

75 .0%. good 

12. 5% not good 

"Were the necessary supplies available to you?" 
100. 0% strongly agree 

Participant comments ■ 

*. "no heat sometimes" 

All eight participants showed significant improvement from 
when they took the pre-assessment to when they Look the 
post-assessment . 

The average pro-assessment score was 26 . 0" o and the average 
post-assessment score was 81-25%, an improvement of 53.25 
percentage points. All participants were very proud of 
their results! (note - I did not include Charles, Herbert or 
Creasie as they did not take the final exam) 

This Communications course provided these participants with 
the chance to use skills that they have not used for a long 
time. I think the participants feel more comfortable with 
skills like using the dictionary, sounding out a word that 
they do not know, and reading aloud. 

My assessment is that the participants need some stronger 
phonics work ie . vowel sounds, pronunciation, syllabication, 
accents, etc. Many of these participants were at a lower 
level than some parts of the curriculum. For two of the 
students it was very difficult as English is their second 
language . 

Some of the participants mentioned that they are concerned 
that the math courses they will be taking will be too hard. 
I assured them that it would match their abilities per the 
pre-Tabe test. 
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100.0% rated the instructional materials (textbook/workbook, 
and syllabus/outline) most helpful, 
rated the computer-based training helpful . 
rated the instruct ional methods and aids most helpful/ 
agreed that the materials were well organized. 



77 
^100 
100 



0% 
0% 



INSTRUCTOR: 

y ioo.o% 



rated the instructor excellent on organization and 
pre pa ration, mas t ery of subject mat ter , ability to 
make participants to feel welcomed and at ease, 
willingness to answer questions, and the ability to 
communicate the subject matter to the participants. 
100.0% indicated they would take another course with this 
instructor . 

Participant comments on the instructor include the 
following: 

"The teacher was excellent." 
"This course gave me a second chance." 

I don 1 t want to leave/' 
"A pleasant person." 

"Our instructor was great. Took as much time 
as she could! Answered all questions!" 
"I would like to take Math II w i th this 
instructor. It was a pleasure." 
"The instructs did a very good job and made 
me feel more relaxed with the course." 
"Nancy made the learning process a lot easier 
than what I remember from my years in jr. 
high and high school. She seems to care that 
you learn and retain. " 



FACILITIES 



87.1% rated the quality of the training room very good or 
excel 1 ent . 

96. S% agreed that the necessary supplies were available to 
them . 

Par t i ci pant comments on the facilities include the 
f ol lowing : 

* "Too hot and s tuf f y on some days . " 

* "Everything was wonderful. It was a 
p 1 easure . " 
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INSTRUCTOR COMMENTS : 

The Mathemat i cs-on- the- Job I participants were a hard-working, 
motivated group of individuals. It was an enjoyable and 
refreshing experience for me to have worked with them throughout 
the ten-week period. 

Attendance was outstanding. On rare occasions when a class 
member was absent, he or she would obtain class material upon 
return to class . 

Pre-assessment scores ranged from a low of 12.5/55 = 23% to a 
high of ^3.5/55 = 79% Post-assessment scores ranged from a low 
of 18/55 = 33% to a high of 55/55 = 100% All participants showed 
a gain between their Pre-Assessment and Post-Assessment scores. 
The gains ranged from a low of 1.5 points to a high of 35.5 
points, from a low of 2 per cent to a high of 65 per cent. 

Room temperature ranged between very cool to extremely warm on 
any given day. The temperature controls available in the 
training room appeared to be inoperable. TRW management was 
notified of the uncomfortable temeperature conditions in the 
training rooms . 

In a course, such as this, computer time is strongly recommended 
and encouraged for those participants who can benefit from 
repetition and reinforcement of class information. Many of the 
Math I participants expressed a desire to use the computer lab, 
but because of lack of company time available to develop and/or 
expand their math skills, these participants were unable to 
benefit from the computer facility presently in place at TRW, 

Overall, I found the course to be a rewarding, educational 
exper i ence--both for me and for the participants. The partici- 
pants were challenged to think about, to analyze, and to demon- 
strate their knowledge and ability to use math effectively on the 
j ob . 
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TRW Communications on the Job II Evaluation Summary 

3:00-5:00 p.m. 

Instructor: Sally Corwin-Osgood Date: June 30, 1993 



Participant Progress 

Curriculum based Pre and Post- Assessments were given to 
participants. All participants showed remarkable improvement in 
their pre and post results. Individual improvement ranged from 35 
to 52 percentage points* The class average went from 44% on the 
pre- assessment to 89% on the post-assessment. This reflects the 
fact that 6 out of 7 post-assessed participants doubled their pre- 
assessment scores. 

Evaluation Report 

Course Expectations: Eighty-three percent of the participants 
stated that the course net taeir expectations. One-half of the 
participants thought they had the knowledge and skills necessary to 
take the course. Sixty-six percent of the participants rated the 
time allowed for the class as inadequate. 

Course Content: When asked to rate the practical application of 
the course to their job, as well as helping to be more effective on 
the job, sixty-six percent of the participants responded 
positively. One hundred percent of the participants rated their 
overall impression of the course as high. Participants stated 
unanimously that the course objectives were clearly stated. 
u Eighty-three percent agreed that the course met the stated 
"objectives. Comments about the most useful information presented 
included: 

• "Being reintroduced to the dictionary 1 11 

Methods of Instruction: Eighty-three percent of the participants 
agreed that the exercises and practice of new skills and concepts 
was sufficient. The participants unanimously agreed that the 
text /readings were most helpful of the instructional materials. The 
Audio-visual aids and the computer based training was rated least 
helpful by fifty percent of the participants. Lecture and class 
discussion/questions and answers were rated as most used by one- 
hundred percent of the participants. Eighty-three percent rated 
the text, and exercises as used most. The video portion of the 
class was rated as least, used by eighty-three percent of the class. 
Eighty-three percent of the participants also rated the materials 
as well organized. Comments included: 

• " Company didn't allow enough time" 



Instructor: One-hundred percent of the participants rated the 
instructor at the highest rating in: organization , 
preparation, subject mastery, making participants welcome and at 
ease, willingness to answer questions, and ability to communicate 
the subject matter. The participants unanimously agreed that they 
would take another course with this instructor. These overall high 
ratings in this area seemed to reflect the working cohesiveness and 
cooperation of this top-notch group of adult learners. Comments 
included: 

• "very professional" 

• "very helpful" 

• "very knowledgeable, easy to listen to and well prepared" 

• "The teacher knew the course and what she didn't know, she 

found out. . " 



Facilities: The participants unanimously rated the training room as 
inadequate. Comments included: 

• " too cold!" 

• " Room was either too hot or too cold" 



TRW COMMUNICATIONS-ON-THE-JOB I 
January 27 - April 6, 1993 

EVALUATION SUMMARY 

Instructor: Nancy Hoffstadt Date: April 12, 1993 



COURSE EXPECTATIONS: 

100.0% agreed that the course content met their expectations. 
76.9% agreed that they had the skills and knowledge necessary 

to take the cour s e . 
92.3% agreed that the amount of time allotted for the course 

was adequate. 



COURSE CONTENT: 

8^.6% agreed that this course will help them do their job 
mo re effectively. 
^76.9% agreed that this course has practical application to 
their job. 

-S^.6% rated their overall impression of this course above 
average . 

100.0% agreed that the objectives of this course were clearly 
stated. 

92.3% agreed that the course met the stated objectives. 



Participant comment s on the most useful i nf or mat ion 
presented in this course are as follows: 

* M A1 1 i nf ormat i on in this cour s e was helpful. 

* "How to communicate with other employees' 1 



METHODS OF INSTRUCTION: 

>/l00.0% agreed that there were sufficient exercises/practice 

with new skills and concepts. 
v/100.0% rated the instructional materials (textbook/workbook, 

syllabus/outline, and audio-visual aids) most helpful. 
y'100.0% rated the instructional methods/aids (text, lecture, 
exercises, discussions, Q & A, and videotapes) most 
/ helpful. 
^100.0% agreed that the materials were well organized. 

Participant comments on the methods of instruction 
include the fol lowing: 

* "Very good" 

* "The materials were very helpful." 

* "Well organized" 

* " I r e commend >p en- book testing." 
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TRW COMMUNICATIONS-ON-THE-JOB I 
January 27 - April 6, 1993 

EVALUATION SUMMARY 

Instructor : Nancy Hof fstadt Date: Apr i 1 12 , 199 3 

COURSE EXPECTATIONS: 

100.0% agreed that the course content met their expectations. 
76.9% agreed that they had the skills and knowledge necessary 

to take the course. 
92.3% agreed that the amount of time allotted for the course 
was adequate . 

COURSE CONTENT: 

8^.6% agreed that this course will help them do their job 
more effectively. 
'76.9% agreed that this course has practical application to 
their job. 

-•8^.6% rated their overall impression of this course above 
average . 

100.0% agreed that the objectives of this course were clearly 
stated. 

92.3% agreed that the course met the stated objectives. 

Participant comments on the most useful information 
presented in this course are as follows: 

* "All information in this course was helpful." 

* "How to communicate wi :h other employees" 



METHODS OF INSTRUCTION: 

v/l00.0% agreed that there were sufficient exercises/practice 

with new skills and concepts. 
vl00.0% rated the instructional materials (textbook/workbook, 

syllabus/outline, and audio-visual aids) most helpful 
y'100.0% rated the instructional methods/aids (text, lecture, 

exercises, discussions, Q & A, and videotapes) most 
/ helpful. 
^100.0% agreed that the materials were well organized. 

Participant comments on the methods of instruction 
include the fol lowing: 

* "Very good" 

* "The materials were very helpful." 

* "Wei 1 organized" 

* "I recommend open-book testing." 
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INSTRUCTOR: 



100.0% rated the instructor excellent on organization and 
preparation, mastery of subject matter, ability to 
make participants to feel welcomed and at ease, 
'willingness to answer questions, and the ability to 
communicate the subject matter to the participants. 

100.0% indicated they would take another course with this 
instructor ♦ 



Participant comments on the instructor include the 
foil ow i ng : 

* "Wonderful teacher-- very helpful and 

thought fu 1 " 

* "Very good instructor" 



FACILITIES: 



61.5% rated the quality of the training room very good or 
exce 1 1 en t . 

92.3% agreed that the necessary supplies were available to 
them . 

Participant comments on the facilities include the 
following: 

* "The room temperature was too hot/too cold. 

* "Computer time was not available during, work 

t lme . 



INSTRUCTOR COMMENTS: 

The Communicat ions-on- the- Job I participants were a hard-working, 
motivated group of individuals. It was an enjoyable and 
refreshing experience for me to have worked with them throughout 
the ten-week period. 

Attendance was outstanding. On rare occasions when a class 
member was absent, he or she would obtain class material upon 
return to class . 

Pre-assessment scores ranged from a low of 3/50 = 6% to a high of 
23/50 = ^6%. Post -assessment scores ranged from a low of 13/50 - 
26% to a high of kZ/50 = 96%. All participants showed 
significant gains between their Pr e-Assessment and Post- 
Assessment scores. The gains ranged from a low of k points to a 
high of 32. points, from a low of 10 percentage points to a high 
of 58 percentage points. 

Room temperature ranged between very cool to extremely warm on 
day. 'The temperature controls available in the 



any given 
training room 



appeared to be inoperable. TRW management was 
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not i f i ed . 

Overall, I found the course to be a rewarding, educational 
exper i ence— both for me and for the participants. The partici 
pants were challenged to think about, to analyze, and to demon 
strate their knowl edge 'and ability to communicate effectively. 
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"RESULTS-ORIENTED WORKPLACE LITERACY" 

An Evaluation of the ROWL Project Undertaken 
by the Unified Technologies C enter 

Cuyahoga Communi ty College, Cleveland, Ohio 
July 1. 1992 - Octob er 31, 1993 



I. THE NATIONAL WORKPLACE LITERACY PROGRAM: Background 

The National Workplace Literacy Program (NWLP) , which funded 
this particular project, is administered by the U.S. Department of 
Education. Authorized by the Stafford-Hawkins School Improvement 
Act of 1988, the NWLP is designed to provide financial support to 
workplace literacy demonstration projects operated by partnerships 
of businesses, labor, and educational organizations. The Stafford- 
Hawkins Act is a Congressional response to concerns that an 
increasing percentage of the nation's labor force possessed 
insufficient basic skills and that this situation was adversely 
affecting productivity and U. S. competitiveness in the world 
marketplace. 

The "Results-Oriented Workplace Literacy" (hereafter ROWL) 
project undertaken by the Unified Technologies Center of Cuyahoga 
Community College (hereafter "UTC") in 1992-93 is a direct response 
to the observed effectiveness of previously authorized programs 
( Pelavin Associates , 1991 ) . Components associated with effective 
workplace literacy programs included: 

1. ) Active Involvement by Project Partners... in planning, 

designing and operating the NWLP Project. 

2. ) Active and Ongoing Involvement b} Employees in conducting 

literacy task analyses and determining literacy levels. 

3. ) Systematic analyses of on-the-job literacy requirements. 

4. ) Developing instructional materials related to literacy 

skills required on the job. 

(Pelavin Associates, p. v) . 
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In addition, the FY '92 NWPL Solicitation required a formal 
evaluation plan that would be reviewed by the project participants. 
To ensure that the evaluation design conformed to both U.S. 
Department of Education regulations and to the expectations of the 
individual participants , an external contractor , FLW Associates 
(private specialists in instruction and technology) was retained to 
provide formal evaluation services (Appendix I). 

The agreed-upon evaluation design was to address two major 
questions : 

1. ) Did the ROWL program improve workforce literacy? 

2. ) If so, did improved literacy lead to improved company 
productivity? 

In addition, the evaluation design asked whether or not employees' 
morale improved over the course of the training period. 

II. The DTC and its Workplace Training programs 

Founded in 1986 as a partnership between Cuyahoga Community 
College and the Cleveland Advanced Manufacturing Program 
(C.A.M.P.), and sponsored by Cleveland Tomorrow, the UTC provides 
tailored education and training services to business and industry 
in support of increased quality, productivity and competitive 
advantage > Representative workplace literacy training programs 
engaged in by the UTC include long-term programs for the Ford Motor 
Company, the Ohio Bell Telephone Company (now known as 
Ameritech)and a host of small and medium-sized manufacturers in the 
greater Cleveland Area. The UTC was joined in this application by 
the Employers Resource Council, which provided liaison, team- 
building and dissemination supports. 
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III. THE PARTICIPATING COMPANIES: Common Characteristics 

The three participating companies in the project — Cleveland 

Wood Products , T.R.W. , Inc . and Zircoa , Inc . — share several 

characteristics. As participants in the Great Lakes region 

manufacturing economy their managers agree that they commonly 

suffer, or face the potential of suffering, from a changing 

economy, global competition, and an aging, inadequately-trained 

workforce. They cite industry statistics indicating that a 

significant percentage of manufacturing employees would not be able 

to perform in more complex, technology-oriented environments. Few, 

if any, of the participating companies had conducted inventories of 

the basic literacy skills of their workforces, for a variety of 

reasons. Their shared perceptions, however, lead them to agree, 

with the UTC, on a common goal for the ROWL project: 

"To increase employee-readiness for promotions, increase 
quantity and quality of work, improve job attitudes and job 
knowledge, and decrease error rates and reductions in waste, 
turnover, lost management tine, and downtime through a 
results-oriented applied workplace basic skills enhancement 
program" (Source: A pplication Narra tive: UTC to the United 
States Dept . of Ed., November, 1991). 



For more detail on the participating companies, refer to pages 10- 
15 of the preceding Final Report on the "UTC Nat ional Workplace 
Literacy Proiectf ROWL^ " . 



IV. TRAINEES' JOBS: 

A. Categories: 

1.) Cleveland Wood Products: 

-Machine Operator -Woodshop 
-Bristling Operator 
-Brush Assembler 

2-) Zircoa, Inc* 1 

-Oxygen Sensor Operator 
-Machinist 



Original specification: see Final Report changes, 
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-Fine Grain Batch Mixer 

3.) TRW, Inc. 

-Machinist 
-Material Handler 
-Inspector 

B. Examples of Duties 

-Machinist: Read and interpret SOP, transfer Quality 
Control information, apply computation & measurement 
skills to machine cutting, feeding, etc., 
understand process flow... 

-Sensor Operator /Bristling Operator. 

Understand/comprehend process flow, read blueprints 
(common to virtually all job categories), use 
Quality gauges, read orders... 

-Inspector: Read/interpret electronic gauges, transfer 
quality control information, apply SPC 
techniques .... 

C. Company Problems, external indicators: 

Cleveland Wood: Poor quality, scrap and rework, downtime, 
warranty returns , etc . . 

Zircoa, Inc.: Measurable scrap costs, rework costs, 

rework, on-time delivery often attributable to lack 

of sufficient entry level skills to accomplish assigned 
tasks. 

TRW: Incorrect SOP interpretations leading to excessive 
defective parts , scrap ; machine damage ( and production 
delays and costly repairs resulting from); severe recall 
costs ,lack of accurate quality information); improper 
movement of parts and wrong parts shipped, etc.. 

V. TRAINEES' DEMOGRAPHICS 

There was a total of 388 subjects in the evaluation from whom 
at least some data were available. Complete data on all variables, 
however, were available from only about half this number. Attrition 
of subjects, mainly because of company layoffs , was high. 
Nonetheless, enough data are available for a meaningful analysis, 
except for the loss of the control group which was not to receive 
ROWL training. 

The participants had these primary characteristics: most were 
white males between 21 and 40 years old, had high school diplomas 
or Grade Equivalent diplomas (GED's), spoke English as their 
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primary language, and had an average of 10.8 years on the job. 
There were, however, significant numbers of women, minorities and 
workers of all ages. See Appendix II for details. 



VI. DETAILS OF TRAINING PLAN. 



Refer to the "Final Report on the UTC National Workplace 
Literacy Project fROWLV . pps. 1-8, for details of the general 
process: the facilities utilized, the materials and the proposed 
and implemented methods. 



VII. EVALUATION DESIGN. 

See page 1 (above) for the broad goals of the Evaluation Plan. 
The process and timelines that were to be followed are described in 
Appendix III : The NWLP Evaluation Plan: " Results-Oriented Workplace 
Literacy" . In terms of scop e , FLW proposed to examine the following 
areas : 

- Review of Training Products (curriculum/courseware) developed 
by the grant administrator and/or utilized in the self -paced, 
independent study laboratories. We proposed to utilize the 
training materials evaluation model employed by the Northwest 
Regional Educational Laboratory in collaboration with Conduit 
and MicroSIFT . supplemented by on-site visits to answer such 
questions as: 

Content: is the material accurate; does it have 
educational value; is it free of apparent cultural bias? 

Instructional Characteristics : Is the purpose of the 
educational package well-defined; does it achieve its 
defined purpose; is the scope/sequence clear, logical and 
at the appropriate level of difficulty...? 

Technical Characteristics: Are the user support materials 
comprehensive , effective? Can the learners easily and 
independently access and operate the support materials 
package? 

- Effectiveness of trainers /methods: Using a structured 
questionnaire derived from the work of Macaulay, et. al. 
(1994), and adapted for use in a similar NWLP project in 
Worcester, MA., we proposed interviews with clients and their 
supervisors, supplemented by on-site observations, in order to 
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ascertain measures of instructor and material effectiveness. 

- Results achieved: The final report was to address two key areas of 
quantitative analysis: 

1 . ) "Literacy" Gains : as measured by standardized 
achievement tests, administered in a pre- and posttest 
design, (see: "Instrumentation" , below) . 

2. ) "Productivity" Gains: as measured by the indicators 
posited by the three companies : e . g . , amount of 
waste/scrap product; down time due to machine repair, et. 
al . , returned parts/orders and negative customer 
feedback; unplanned absenteeism, et.al. . 

Further, FLW proposed to assess attitudinal gains as measured by 
the work Environment Scale (WES) as part of the overall pre- and 
posttest design, and to explore the linkage between achievement and 
productivity in an attempt to quantify overall changes in attitude 
for workers, supervisors, and management. 

- Qualitative analysis: The above measures were to be 
complemented and/or validated by means of on-site visitations 
and structured interviews (Appendix VI), in an attempt to 
drive out, in a qualitative manner, some of the contributing 
causes and/or unanticipated consequences of observed changes 
due to the intervention program at any of the three sites. 



- Overall Effectiven ess of Training: Did trainers, productivity 
and clients change in the anticipated direction during the 
course of the intervention project? Was there observable 
change (and thus some measure of inferred causation ) versus an 
identified control group bearing demographic similarity to the 
treatment group? 



Disproving the Null Hypothesis: The null statistical 
hypothesis predicts no significant difference between pre- and 
posttest scores, beyond those attributable to chance. If the 
ROWL program were effective, however, the posttest scores 
would be significantly higher than the pretest scores. 
Accordingly, it was expected that participants in the ROWL 
training program would exhibit: 

1. ) A gain in general literacy, as indicated by pre- and 
posttest scores on the TABE and TALS. 

2 . ) A larger gain in job-specific literacy tasks , as 
evidenced by pre- and post, criterion-referenced test 
scores (curriculum based). 
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3.) An improvement in (individual and collective) 
attitudes towards the workplace, as measured by the Work 
Environment Scale (below), and supplemented by non- 
scientific on-site interviews. 
VIII. Instrumentation . 

1.) Standardized tests. The attempt was made to administer 
the Test of Adult Basic Education (TABE) to all subjects, both 
before and after training, or, in the case of the control group, in 
the absence of training after an equivalent interval. A small sub- 
group was given the Test of Adult Literacy Skills (TALS) in order 
to validate it as an alternative measure of adult literacy, and an 
assessment of generic job-related skills. Details: 

-TEST OF ADULT BASIC EDUCATION (TABE) , in "Survey" (shortened) 
form was administered to the general training population and 
used as a baseline for placing participants in the ROWL 
program (5 "tracks"); another version was also administered to 
all participants in the project at the end of the delivery 
phase in order to assess possible achievement gains. 

-TEST OF APPLIED LITERACY SKILLS (TALS): Taking seriously 
Sticht's (1990a) injunction that we should measure both 
content knowledge ansL- w ---the types of knowledge and skill 
that they possess regarding ...working with knowledge for 
doing something or learning something", FLW proposed the use 
of the ETS-derived TALS, to be administered to selected 
participants at the beginning and end of training delivery in 
order to pilot test it as a standardized instrument to be used 
as an alternative to the more academic TABE. As Bishop (1991) 
succinctly states: "There is as yet no empirical evidence 
demonstrating that the literacy skills test scores are 
correlated with doing a better job in specific jobs..." (see: 
preceding Final Report, p. 4, and Bishop, J. "The Pr edictive 
Validity of the ETS Tests of Adult Literacy Skills, attached 
as Appendix IV) . 

2 . ) " Productivity" Gain s : Indicators of waste , down-time , 
absenteeism, "quality" feedback from customers and supervisors, 
returned orders, etc. were to be provided by the companies, as 
stipulated in the Grant Proposal. 

3. ) " Attitude Chang e": The Work Environment Scale (WES) was to 
be used (pre- and post) to assess employee attitudes relative to 
the workplace. 
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4. ) "Effectiveness" of Trainers, Curriculum, Methods: In 
observing trainer effectiveness, the aforementioned (Macaulay, et. 
al. -derived) Observation Checklist was utilized on-site by two 
trained observers; the NWREL/Condu i t /Mi cro SIFT Courseware 
Evaluation form was used to evaluate the courseware utilized in the 
self-paced laboratories (Attachments I and II). 

Comments on the v alidity /reliability of the above measures; 

The TABE has well-established norms, validity, and reliability 
with a general population of adult basic education students; it 
is, however, somewhat academic in flavor and may not measure what 
it was purported to measure in terms of job-related skills, 
abilities and aptitudes. 

The data provided by the publisher of the TALS ( Educational 
Testing Services) indicates that it was norraed with an 
adolescent/high school population, making its applicability to the 
adult population of the ROWL project somewhat questionable, ETS 
provides statistics supporting its reliability. According to 
Bishop ( op.cit., p. 2.), the TALS has both high face validity and 
high content validity, but it may not predict how well a person 
will function in a (new ) job. The WES is the only workplace 
attitudinal assessment tool with established norms and reliability 
indicators. The Conduit/MicroSIFT Courseware Evaluation form has 
been in use since 1980 across a variety of school districts and 
college/JTPA populations. Since it is, by definition, somewhat 
subjective, its reliability has not been established. 



IX. RESULTS 

A, Pre- and Posttest Scores. 

The following are the means and their differences between pre- 
and posttests on the standardized test scales. The asterisks 
indicate that the differences are statistically significant as 
determined by the_fc test, the standard statistical test of a non- 
chance difference between two means. The asterisked values below 
show that these differences did not occur by chance alone. They 
may or may not have occurred because of the effects of the 
training. See Appendix V for detailed statistics. 



TEST SCORE OR SCALE PRE- POST- MEAN OF DIFF'S 

("*" means t test value was significant, p < .05) 

TEST OF ADULT BASIC EDUCATION (TABE) 

Reading standard score 
Reading percentage 
Reading stanine level 
Reading grade equiv. 

Math standard score 
Math percentage 
Math stanine level 
Math grade equiv. 

TEST OF APPLIED LITERACY SKILLS (TALS) 



764 


.66 


767 


.42 


+ 9. 


53 




73 


.08 


75 


.94 


+ 7. 


18 


* 


6 


.61 


6 


.86 


+ 0. 


58 


* 


9 


.76 


9 


.88 


+0. 


56 


* 


765 


.03 


771 


.66 


+ 12. 


42 


* 


66 


.71 


70 


.01 


+ 6. 


18 


* 


6 


.19 


6 


.54 


+ 0. 


53 


* 


8 


.63 


9 


.09 


+ 0. 


76 


* 



TALS derivative score 279.06 286.00 
TALS quantitative score 297.14 307.83 



+0.43 (n = 23) 
+3.48 (n = 23) 
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CRITERION (CLASS-BASED) TESTS 



First class (%) 
Second class (%) 



39.67 
43.49 



WORK ENVIRONMENT SCALE (WES) 



RAW SCORES 



PRE- 



65.19 
73.48 



POST- 



+24.69 * 
+29.45 * 



MEAN OF 
DIFF 1 S 



NORM 



RELATIONSHIPS 

1. Involvement 3.57 

2. Peer cohesion 4.53 

3. Supervisor support 4.14 

PERSONAL GROWTH 

4. Autonomy 4.43 

5. Task orientation 4.56 

6. Work pressure 4.69 

SYSTEM MAINTENANCE 
AND CHANGE 

7. Clarity 3.79 

8. Control 4.87 

9. Innovation 3.39 

10. Physical comfort 2.28 



3.79 
4.57 
3.88 



4.85 
4.89 
5.05 



3.62 
3.62 
4.01 
2.34 



+0.01 
+ 0.04 
-0.23 



+ 0.33 
+ 0.45 
+ 0.58 



-0.18 
-0.42 
+ 0.52 
-0.11 



5.95 
5.70 
5.68 



5.54 
5.90 
4.40 



5.60 
4.88 
4.42 
4.89 



WORK ENVIRONMENT SCALE (WES) 
SCALE SCORES PRE- 



POST- 



MEAN OF DIFF' S. 



RELATIONSHIPS 

1 . Involvement 

2. Peer cohesion 

3 . Supervisor support 

PERSONAL GROWTH 

4 . Autonomy 

5. Task orientation 

6 . Work pressure 

SYSTEM MAINTENANCE 
AND CHANGE 

7. Clarity 

8. Control 

9 . Innovation 

10. Physical comfort 

PRODUCTIVITY 

ZIRCOA MONTHLY AVERAGES 
DIFFERENCE 



32.98 
39.84 
39.07 



41.00 
39.58 
52.00 



35.94 
49.82 
43.36 
30.19 



32 .50 
38.00 
35 .78 



42.27 
46.58 
46 .19 



33.51 
48.82 
44.74 
27.99 



■2. 10 
■2.51 
■3.74 



+ 0.32 
+7.86 * 
-4.28 * 



-2.75 
-0.80 
+ 0.63 
-1.76 * 



PRE- POST- 
(7-9/92) (3-5/93) 



1. Product complaints 

2. Absenteeism 

3. Tardiness 

4 . Accidents 

5. "Speeds & selects" 
(scrap in $) 

TRW MONTHLY AVERAGES 



11.33 
0.7% 
0.4% 
3.67 
80M 



PRE- 

(10-12/92) 



1 , 
2, 
3. 
4. 
5 



Product rejections 1-4/93 13960 

Product complaints 1-4/93 955 

Labor cost standard hr. 37.27 

Absenteeism 2.13% 
Accidents 



CWP MONTHLY AVERAGES 
DIFFERENCE 



1. Product scrap in $ 

2 . Product returns 

3. Pieces per man hr. 

4. Absenteeism 

5. Accidents 



PRE- 

(1-3/93) 

14. 5M 
7.33 
7 .59 

3.33 



13.67 
0.6% 
0.5% 
4.0 
72M 



POST- 
(7-9/93) 



37.59 
2.5% 



POST- 

(7-10/93) 

10. 2M 
8.75 
7.87 

1 .00 



+2.34 
-0.1% 
+0.1% 
+0.33 
-81. 



DIFFERENCE 



+ 0.32 
+ 0.37 



-4.3M 
+ 1.42 
+0.28 

-2.33 



C. Attitude Survey 

The following is a summary of results from an informal, non- 
scientific survey administered "on the floor" at two of the 
participating companies as a part of the formative (ongoing) 
evaluation. The survey, using an ad hoc , structured interview 
devised by FLW, gathered verbal data on the impact of the ROWL 
training program among participating workers and other personnel, 
including management. Its primary purpose was to capture 
information about the training program that may not have been 
solicited by the WES or by other formal, written evaluative 
materials. Because the respondents were not chosen at random, but 
merely at FLW's convenience during two site visits, the results 
cannot be viewed as indicative of all employees' attitudes toward 
the program. There was a total of 22 respondents. 
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1. Is following written instructions a requirement of your 
(your staff's) job? 

Yes = 82%, No = 18% 

2. Is calculating figures, say in using a formula, a 
requirement of your (your staff's) job? 

Yes = 91%, No « 9% 

3. Is precise measurement a job requirement? 
Yes = 73%, No = 27% 

4. When you started your job, could you easily follow written 
instructions? 

Yes = 73%, No = 27% 

5. When you started your job, could you easily perform the 
necessary calculations? 

Yes = 86%, No = 32% 

6. Are written instructions available for tasks necessary to 
perform the job? 

Yes = 86%, No = 14% 

7. Do you believe the training program will help people in it 
to improve their work skills? 

Yes = 100%, No = 0% 

8. Do you believe the program is the right length (of time)? 
Yes - 55%, No = 5%, No opinion = 45% 

9. In the long run, do believe the program will lead to 
greater company productivity? 

Yes = 77%, No = 9%, No opinion = 14% 

10. In the long run, do you believe the program will improve 
people's job satisfaction? 

Yes = 68%, No = 18%, No opinion = 9% 

11. In the long run , do you bel ieve the program will 
encourage people to further their formal educations? 

Yes = 59%, No = 32%, No opinion = 5% 
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D. Evaluation of Instruction 

The following reflect observations made in conversations with 
ROWL management personnel on February 12, 1993 at the Unified 
Technologies Center and also on-site visits to Zircoa , Inc. on 
February 15, 1993, and TRW on 4/21/93, during which time classroom 
observations were undertaken and follow-up conversations with the 
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course instructors and clients ensued. 



SUMMARY COMMENTS FROM OBSERVERS: 

I. ZIRCOA, INC. (RLW) 

In general: the instructor appeared quite competent, was 
facile in engaging the class in "active" learning, used peer 
tutoring techniques to advantage and made herself available 
for individualized learning experiences as time allowed. She 
— and Zircoa — were the most committed of the 3 sites to the 
establishment and (relatively) smooth administration of a 
self-paced, individualized learning laboratory as a complement 
to (lecture/text) instruction. From a Direct Instruction, 
theoretical viewpoint, she provided, or attempted to provide, 
opportunities for drill-and-practice to "firm up" the 
students' grasp of the subject. 

The intervention could 've been improved by: 1 . ) a lengthier 
instructional cycle (a common theme in NWPL evaluations); 2.) 
more application exercises, discriminations and exercises in 
the printed material (related to #1, above); and (3), more 
self -paced workstations and more/better access to the 
Individualized Learning laboratory. 

All-in-all, however, not a bad first pass at the project's 
stated goals and objectives. (See Attachment I, for details). 

II. TRW (JF) 

From this observer's viewpoint, the environment and delivery 
of workplace-related basic skills materials was nearly ideal 
at the TRW site. The class size was small (N=8) and the 
learners entered at about the same level. The room was quiet, 
tidy md comfortably arranged with tables and chairs. A 
competent teacher delivered a well-organized lesson that 
addressed previously determined goals appropriate for jobs 
held by the students. There was ample evidence that the 
students were learning basic arithmetic and were motivated to 
move through the levels as far as they could go during the 
time allowed. 

On the other hand, there was little provision for self -paced 
learning, in which the learner could enter and leave the 
learning curve as his prior learning allowed and accelerate as 
quickly as his/her skills and available time permitted. (See 
Attachment II, for details). 

E. Evaluation of Materials 

The well-designed and seemingly adequate nature of the 
curricular materials has been commented upon above: these 
observations in mathematics apply to the Reading/Writing 
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materials as well, since much the same process was used, and 
the clients ( students ) reported equal satisfaction with the 
latter. Due to time constraints, the materials were somewhat 
truncated and compact, however; which may've caused 
instructors and students at the lower end of the entering 
skills continuum some difficulties. 

Utilizing the Courseware Evaluation form from NWREL/MicroSIFT, 
the evaluators offered observations on the (apparently 
popular) self-paced learning materials used in the 
individualized study laboratory (Zircoa, in particular) , which 
is displayed here as Attachment III. 

X. DISCUSSION AND RECOMMENDATIONS 

The above data summary and Appendix V provide modest yet 
significant support of the efficacy of adult worker literacy 
training programs, both in general literacy and in specific job 
related literacy. Gains were evident in all areas measured by the 
TABE and TALS. Although the latter gains were not statistically 
significant because of the extremely small size of the TALS sub- 
sample, the absolute pre- to posttest differences suggest that such 
gains may have been significant with a larger TALS sub-group. 

The modest gains in literacy , however , did not transfer to 
significant gains in worker morale as measured by WES. The one 
exception to this pattern was the Task Orientation Scale, which did 
show a significant increase. This variable, nonetheless, is very 
important in an industrial climate wherein worker safety and 
physical productivity are vital outcomes. 

One caveat is absolutely essential to interpreting these 
results. Despite a strong effort by the UTC to enlist an 
independent control group that would have been administered the 
same pre- and posttest instruments as the participating workers 
(but without the training) , unanticipated worker layoffs by a 
fourth company eliminated this group in the midst of the ROWL 
program. As a result, from a scientific perspective, a positive 
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cause- and-ef feet inference about the effects of the ROWL training 
is not possible. It can be concluded, however, that the observed 
gains in literacy did not occur by chance alone. One can only 
speculate that the training program was the cause of the gains, 
ruling out other factors. 

Some possible other factors that may explain the observed 
gains (or lack thereof) are, first, the simple exposure to a 
testing and classroom process which was probably absent from many 
workers' lives for many years. Initial anxieties about taking a 
battery of standardized tests, in particular the TABE and the 
criterion-based classroom tests, may have diminished as 
participants grew more comfortable with educational materials and 
small academically-oriented environments within their immediate 
workplaces. 

Second, the fact that the WES scores of morale showed little 
or no gain (with one exception) might be explained by the current 
climate of the local economy in which recession and company layoffs 
have tended to maintain low morale among many, if not most, workers 
in a mature local manufacturing economy. The low morale was most 
clearly evident in comparing the mean participants' raw WES scores 
to national norms (based on a national sample of both blue and 
white collar workers). 

The on-site observations of the program instructors and the 
instructional materials indicate that the quality of both was high. 
However, because of the different entry points of trainees into the 
curriculum, as determined by the TABE Survey test, and because of 
the "late bloomer" phenomenon, we recommend that future literacy 
training programs offer a greater quantity of easily-accessible, 
individualized, self -paced instructional materials, perhaps 
computerized multi-media programs. Such programs would enhance, 
but probably would not replace classroom instruction. 

In conclusion, there appears to be substantial evidence that 
the ROWL program accomplished its goal of improving workplace 
literacy. The relationships among literacy, productivity, and 
morale, however, remain unclear. We recommend that these 
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relationships be studied over a much longer period, utilizing 
longitudinal measures of literacy, productivity, and morale. 
Based on classroom observations, discussions with instructors and 
clients and upon inspection of the curricular materials, we 
recommend that a much longer training cycle (delivery of services) 
be utilized. Moreover, we recommend that future similar endeavors 
develop training programs that are more directed toward specific 
job skills. Specific "job-related skill assessment is one of the 
goals of the TALS, which might be utilized more vigorously in 
future studies. 

ATTACHMENTS (2): Teacher Evaluation Checklists 
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Attachment I • ( Zircoa ) 

WORKPLACE EDUCATION 
Teacher Observation Checklist 

I. THE INSTRUCTOR DEMONSTRATES AUTHENTICITY AND CREDIBILITY. 
Indicators : 

1 . Demonstrates command of subject. 

CQIFUWTrtg ; Yes , but my general impression was that the 
instructor was inexperienced in presenting concepts in more 
than one fashion (i.e.; if not understood the first time, 
grasped for an alternative explanation). Discriminations 
between instances and non-instances of the concept were not 
introduced, no doubt due to time constraints. 

In general, the lack of sufficient time to cover the concepts 
for those being exposed to them for the first time will be a 
recurring theme in comments which follow. 

2. Acknowledges students' knowledge and experience about the course 

content • 

Comments : Yes, the instructor did a good job with this (& see 
questions 6, 17). 

3. Shows a willingness to admit errors in front of students. 

Comments ; Yes, but not too applicable, here. 

4. Shows a willingness to communicate feelings or to reveal the 
personal side of self, as appropriate. 

Comments : Yes. 

5. Speaks in a clear, audible voice. 

Comments : Yes. 



6. Uses appropriate vocabulary level and detail of explanation in 
class. 

Comments ; Instructor sought to paraphrase the text, where 
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possible, and to relate its vocabulary to the job context. 
Instructor paraphrased the text when felt she was losing the 
class. In general, instructor preferred anecdotal, "real 
world" language to the formal language of mathematics — which 
seemed quite appropriate. 

Provides assistance and/or positive reinf orcement . 

Comments : Yes, about 60% of class time — exclusive of breaks 
— was devoted to this effort, including the provision of 
positive reinforcement (i.e.; the instructor would circulate 
during class as students attempted to solve problems). 

Accomodates a variety of abilities in a multi-level class. 

Comments : This was difficult to do, given time constraints, 
the vagaries of the placement process (of which, more later). 
In general, the instructor was forced to target instruction 
towards the bottom 1/3 of the bell-shaped abilities curve. In 
this case, this was a cadre of 3-4 students to whom pre- 
algebra mathematics was a new learning experience, never 
before having encountered this material. 

The instructor creatively involved those who only needed a 
refresher course (in order to quickly be reminded of the 
concepts) as tutors P in group learning situations, for the 
others. In cognitive psychological terms, these students had 
never truly forgotten algebraic and pre-algebraic concepts 
learned in high school: due to the passage of time, their 
retrieval capacities merely needed to be reactivated. Once 
this was accomplished, their "learning" curve was stupendous 
(they could've "tested out", had another course been 
available) • 

Designs varied instructional format to accommodate multiple 
learning styles. 

ComentS T The instructor worked hard to supplement the 
manual with explanations in class which varied the tone of the 
material, attempting to apply it to the real world. She 
supplemented the manual with many problems of her own 
derivation, for those students (and there were several) who 
needed more practice . Beyond lecture, there was small group 
work (see #8, above), and the provision of an opportunity to 
attend a self -paced lab offering CAI and CD-ROM (audio) 
materials for those who had not achieved total understanding 
during classroom and home-study sessions. The self -paced lab 
seemed to work best, in the instructor's observations, when: 

a. ) a lab assistant was present to help orient the student; 

b . ) the students visited the lab in pairs , which provided 
positive reinforcement and helped to overcome "Computer- 
Phobia. " 
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The multimedia laboratory experience in mathematics f Ferranti 
courseware), in particular, provided a high degree of learner 
control ( entry/exit with bookmark , self -paced , varied 
presentations of material). In addition, as with most quality 
multimedia software (this had been positively evaluated by 
national evaluation panels such as "Project Synergy"), there 
was an observed positive effect on learner motivation f due to 
the video examples and positive reinforcement provided. Sadly, 
however, there was only one workstation provided with this 
courseware and one hour per week with which to take advantage 
of it . Thus, the broad applicability of the mathematics 
portion of the self -paced laboratory was somewhat limited. 



10. Responds appropriately to student comments. 

Comments ; Yes, but see comment #1. Instructor very good at 
providing heaping amounts of positive reinforcement. 



11. Uses appropriate questions — open, closed, directed? 

Comments ; Instructor alternated, first providing direct 
instruction of concepts ("closed"), then opening up and or 
directing the questions, once the concepts had been "learned". 
This seemed quite appropriate to the varied needs of the class 
and seemed to provide the appropriate structure. 

12. Distributes questions evenly among students. 

Comments : Yes, instructor drew out all members and controlled 
the "over-eagers. " (There was one member who couldn't have 
been drawn out, regardless; but instructor attempted to catch 
up with him during problem-solving periods). 

13. Rephrases, redirects, defers questions. 

Comments : Yes ; excellent at rephrasing questions in 
mathematical terms ("Where have we seen this before?"), and at 
deferring questions until appropriate (see #11). 

14. Manages transitions between learning objectives smoothly. 

Comments : Yes, aided by manual. 

15. Allows ample time for students to apply material presented. 

Comments ; Within* time constraints of class , tried to apply 
material to workplace environment. Some members of the class 
were quite good at this, and instructor utilized them well. 
In addition, the self -paced lab provided materials/problems in 
an appl ied context , for those who were able to avai 1 
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themselves of its services. 

16. Uses appropriate illustrations , visuals, etc.. 

Comments: Manual itself was quite visual and made good use of 
graphics — which were mostly job-related ("Masters" of the 
various job classifications had been helpful in identifying 
and assembling these materials)* Instructor supplemented with 
drawings/illustrations on blackboard, 

17. Relates new learning to prior learning. 

Comments : This was one place in which the instructor really 
shone. The manual itself was quite condensed, almost 
epigrammatic. Instructor superimposed a virtual "Spiral 
curriculum" over the printed materials, relating each new 
concept to material previously learned — again, demonstrating 
her thorough knowledge of subject matter. 

18. Uses materials which are relevant to program goals. 

Comments : The manual itself dictated that this would be done. 
Instructor followed manual closely but was only able to cover 
70% of the material due to the learning difficulties of the 
bottom 1/3 of the class (see #8, above). 

19. Encourages collaborative learning. 

Comments : Instructor made good use of collaborative learning, 
using accomplished students in group study situations (above) 
and sending students to the laboratory in pairs, where 
possible. 

20. Incorporates group projects or team presentations. 

Comments : Yes, in problem-solving sessions. 

21. Works jointly with students in decision-making processes. 

Comments ; Apparently, this occurred in earlier classroom 
sessions pertaining to amount of material to be covered, 
utilization of self-paced lab — not directly observed by this 
observer. 



II. FEEDBACK AND EVALUATION. 

Indicators: 

22. The instructor provides effective feedback and methods of 
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Comments : Yes, utilized: l.)Frequent quizzes (graded and 
passed out before the following class)? 2 .) Individual 
conferences with students upon request; 3.) Instructor 
presence in the self-paced lab 3' per week — almost 
mandatory, as placement exam(s) for self-paced material 
would ' ve been cumbersome for students to use without 
help; 4.) telephone calls to her home when students were 
having particular difficulties. The students , 

themselves, seemed highly motivated and took advantage of 
all these opportunities, it seemed to this observer. 

23. Provides timely, individually affirming feedback to students. 

Comments ; This was difficult, if not close to impossible, 
given the time constraints of the class, the large amount of 
material to be covered. Instructor tried, during break time 
and laboratory time, to provide this typed of feedback where 
possible (and see: individual appointments, referred to 
above). In general, it seemed the instructor was highly 
motivated herself in this area, and went far beyond her job 
description in attempting to ensure success for these 
students . 

If the program were being redesigned tomorrow, this area 
(including enhancement of the laboratory) would be a prime 
target for more resources, according to the instructor. 

24. Solicits feedback regularly from students regarding his/hex' 

teaching style. 

Comments : Somewhat, but not too applicable due to "direct 
instruction" approach, which seemed appropriate at this level 
(and see: Rosenshine, 1988).. 

25. Creates sense that the learners are in control of their 
outcomes • 

Comments : Somehow, perhaps early on, this seemed to have been 
accomplished, even for those at the bottom of the bell-shaped 
curve. These students put in a lot of outside class time on 
their own and seemed incredibly motivated to succeed. 



Attachment II (TRW) 



WORKPLACE EDUCATION 
Teacher Observation Checklist 

I. THE INSTRUCTOR DEMONSTRATES AUTHENTICITY AND CREDIBILITY. 
Subject: Place values and simple division. 

Indicators: The classroom was arranged quite nicely for students to 
see, hear and view a marker board at which the teacher illustrated 
all of her work. Table surfaces were ample and lighting was good. 
The curricular material was enclosed in binders, to which students 
added work exercises as they were covered. (N==8 students) . 

1 . Demonstrates command of subject. 

Comments: Ms. Hoffstadt's presentation of concepts w<*s well- 
organized and clear. She had obviously planned a systematic way of 
getting her information across, point-by-point, thereby reflecting 
her considerable grasp of the content. 

2. Acknowledges students' knowledge and experience about the course 

content. 

Comments : Students raised questions spontaneously and they 
were fielded as they were raised. Frequency of questioning was not 
great, probably because of the clarity and the ease of the 
material. A certain formality (Direct Instruction) prevented 
discussions from getting off track at the expense of her 
instructional design. 

3. Shows a willingness to admit errors in front of students. 

Comments : Not observed. 



4. Shows a willingness to communicate feelings or to reveal the 
personal side of self, as appropriate. 

Comments : Ms. Hoffstadt attempted to set a warm, accepting 
atmosphere by relating comfortably to her students. Even her 
opening remarks were aimed at countering any lingering anxiety felt 
by adult learners. 
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5. Speaks in a clear , audible voice. 

Comments ; Her voice was clear and could be heard throughout 
the room. Her manner of address, although comfortable, was forceful 
so that the students paid attention. 

6. Uses appropriate vocabulary level and detail of explanation in 

class. 

Comments : Every effort was made to state things in a way that 
could be understood. Details, including repetition and restatement 
of previous points, were present, especially at the beginning of 
the lesson. Instructor paraphrased the text when felt she was 
losing the class. 

7. Provides assistance and/or positive reinforcement. 

Comments : Ms. Hoffstadt's manner was pleasant. She called 
students by their first names and interjected reinforcing comments 
into her answers, such as: "That's a good question; I'm glad you 
asked that." 

8. Accommodates a variety of abilities in a multi-level class. 

Comments ; This was a group that placed very low on the 
arithmetic placement test. However, as the lesson progressed, 
certain of the students demonstrated greater command of the 
material, due to recall of the concepts from their youth. Ms. 
Hoffstadt tapped this set of "peer-tutor" resources in order to 
achieve understanding on the part of the rest of the group. 
Flexibility in reaching all levels was thereby demonstrated. 

9. Designs varied instructional format to accommodate multiple 

learning styles. 

Comments : Scores in arithmetic were examined before 
instruction began. Ms. Hoffstadt planned lessons for the very 
deficient students by arranging content that could be illustrated 
in job applications while making full use of the marker board to 
work calculations. Others in the group watched, but were more apt 
to complete a greater portion of the worksheet application after 
the presentation. This provided a sense of individualization for 
the better-skilled student. Their help came during the study 
periods. 

10. Responds appropriately to student comments. 
Comments : Yes. 

11. Uses appropriate questions — open, closed, directed? 
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Comments ; Instructor asked easy questions, frequently — a 
hallmark of successful direct instruction. Students gained a sense 
of pride in being able to respond, especially the more verbal 
students . 

12. Distributes questions evenly among students. 

Comments : A few students emerged as the 11 experts " on the 
subject matter. 

13. Rephrases, redirects, defers questions. 

Comments : Yes; questions from the students were used in the 
lesson as springboards for explanations. 

14. Manages transitions between learning objectives smoothly. 

Comments : The pace was appropriate , although repetition and 
pauses occurred less frequently, as she found it necessary to 
accelerate the lesson as the hour passed. There was ample time to 
deal with worksheets and study assignments, however. 

15. Allows ample time for students to apply material presented. 

Comments : Yes, covered in #14. 

16. Uses appropriate illustrations, visuals, etc.. 

Comments ; All arithmetic concepts and their calculations were 
illustrated on the marker board. 

17. Relates new learning to prior learning. 

Comments : I was very impressed with her attempts to build 
understandings based on what they brought to the class from their 
jobs. There was a clear use of bridges from job-related 
applications to classroom applications. The staff had done a good 
job at identifying the mathematics useful in the plant, even to the 
extent of job-by- job analyses. 

18. Uses materials which are relevant to program goals. 

Comments : A hierarchy of mathematics skills was worked out and 
compared to the mathematics demanded on the job. Observed on this 
occasion was the basic group and more than likely they will 
progress through the prescribed levels in subsequent training (and 
see: Final Report). Program goals were adhered-to in this fashion. 

19. Encourages collaborative learning. 

Comments : This material did not engender a good deal of 
collaborative learning. 
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20. Incorporates group projects or team presentations. 

Comments : Not applicable. 

21. Works jointly with students in decision-making processes. 

Comments : Not applicable. 



II. FEEDBACK AND EVALUATION. 



22. The instructor provides effective feedback and methods of 
evaluation. 

Comments : Worksheets distributed following the presentation 
were examined, as Ms. Hoffstadt circulated about the room. No 
exams were posed. She expressed a knowledge of how each of the 
eight students were doing and how she was building their skills 
from previous gains. 
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I. FLW Capabilities Statement 

II. NWLP EVALUATION PLAN 

III. Qualitative Analysis: Interview Questions 

IV. Bishop, J., "The Predictive Validity of the ETS Tests of Adult 

Literacy Skills." 

V. Productivity Indicators (By Company) 

VI. a.) Observation Checklist 

b.) NWREL/CONDUIT/MICROSIFT Courseware Evaluation Guide . 



FL WASSOCfATES "Instruction and Technology" 



FLW Associates provides full-service consultant and software 
solutions to instructional problems faced by educators, trainers, 
and publishers. The firm is composed of specialists in adult 
instruction, instructional design, evaluation, measurement, 
computer programming, and computer-assisted instruction (CAI) . 

The principles: 

James A* Frost, Ph.D., is a specialist in educational testing, 
measurement, and reading. For over thirty years, he has 
developed and supervised developmental skills programs for 
students of all ages. From 1966 to 1993, he taught a variety of 
psychology and education courses at Cuyahoga Community College in 
Cleveland, Ohio . 

Kenneth B. LeSure, Ph.D., has taught general and developmental 
psychology at Cuyahoga Community College since 1984. With Dr. 
Frost, he has designed and developed a computerized self-paced 
curriculum in psychology. 

Roger L. Williams, M.Ed, (specialty in instructional 
technology), was an editor, executive editor, and publisher in 
the college textbook industry for many years. Currently, he is 
Director of Learning Resources at Quinsigamond Community College 
in Worcester, Massachusetts. Recently, he was Director of 
Product Development at Systems Impact, a multimedia educational 
publisher, and Manager of Instructional Technologies at 
Cuyahoga Community College, which housed the first full- 
network Level III Interactive Videodisc (IVD) mathematics 
laboratory in the United States. He is an author or co-author of 
several Level III multimedia educational programs utilizing 
authoring languages such as SuperPilot, Quest, HyperCard, and 
Laserworks . 
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Age Dispersion Analysis 



Zircoa Company 



Age 60+ (8.7%) , Age 1 6-20 (2.2%) 



Age 50-60 (30.4%) fiii|||fp.' 



Age 31-39 (39.1%) 



Age 40-49 (19.6%) 



Age 21 -30 (0.0%) 



TRW Company 



Age60+(11.1%) Age 21 -30 (0.0%) 



Age 50-60 (20.4%) 



W&Mp. Age 31 -39 (28.7%) 



Age 16-20 (0.0%) 



Age 40-49 (39.8%) 



Cleveland Wood Products 



Age 60 f (5.3%) Age 1 6- 20 (1 . 3%) 

Age 21 -30 (30.3%) 



Age 50-60 (1 1 .8%) 

•as 



Age 40-49 (28.9%) 
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Age 31 -39 (22.4%) 



345 



Race Dispersion Analysis 

Zircoa Company 



Asian (2.9%) Native American (0.0%) 




TRW Company 



Asian (1.3%) Black (0.0%) 



Hispanic (29.9%) 



Native American (0.6%) 



White (68.2%) 



Cleveland Wood Products 

Asian (2.0%) Native American (1 .0%) 




Education Level Analysis 



Zircoa Company 



College Degree (4.3%) 
Some College (10.6%) UWi. 



H.S. Diploma (46.8%) 




Grade 0-9 (10.6%) 



Grade 10- 12 (19.1%) 



Tech. Program (6.4%) 
GED(2.1%) 



TRW Company 
College Degree (0.9%) Grade 0-9 (3.7%) 
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Cleveland Wood Products 

College Degree (7.8%) ^ Grade 0-9 (6.5%) 

Some College (1 1 .7%) ^?S^M 

« Grade 10-12 (22.1%) 

v;;; ' : ^f^^\ ^ Tech. Program (1.3%) 

GED (9.1%) 



H.S. Diploma (41 .6%) • / -7:-' 
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Years of Service Analysis 



Zircoa Company 



11- 




TRW Company 



41-50 years (0.9%) 



21 -30 years (1 8.7%) 



31 -40 years (0.0%) 



§|||sgl 1-10 years (42.1 %) 




11-20 years (38.3%) 



Cleveland Wood Products 
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THE PREDICTIVE VALIDITY OF THE ETS TESTS OF ADULT LITERACY S KILLS 



J ohn H. Bishop 
Center for the Advanced Human Resource Studies 
Cornell University, Ithaca, 14853 
(607) 255-2742 



Rationale 

Many JTPA programs are evaluating the ETS Tests of Adult Literacy Skills (TALS) as a 
possible indicator of the success of their adult basic education training programs. Labor market 
outcomes, however, arc the primary criterion for evaluating JTPA programs. It is known that 
people who score high on the literacy skills test tend to have better jobs, but there is as yet no ^ 
empirical evidence demon strating that the literacy skills test scores are correlated with doing a better 
job in specific job s. Proof that the skills assessed by the test do indeed make one a more 
productive worker would be of great benefit to JTPA training programs using the TALS. It would 
help program administrators evaluate the payoff to the adult basic skills training and aid in the 
marketing and placement of JTPA clients. Such research is also required before a derivative of the 
Adult Literacy Test could be considered for use for job referral purposes by training institutions 
and the Employment Service. 

Proposed Study 

There is a clear need for research on how well the ETS Tests of Adult Literacy Skills 
predict job outcomes such as supervisory assessments of performance, retention at the firm, 
promotions, and productivity. The best way to conduct such a study would be to administer the 
literacy scales to new hires (or possibly job candidates in the final round of consideration for an 
opening) and to job incumbents and then correlate the scores, a comparison test and some 
background information with indicators of success on the job. The indicators of job success 
would be retention and promotion over the course of the next six to twelve months, confidential 
supervisory assessments of job performance, and, if available ,direct measures of productivity on 
the job.VThe study would focus on a limited number of populous entry level occupations. We 
propose a study which has samples of at least 250 workers per occupation (often from more than 
one corporation) and at least 2000 overall. We are flexible regarding which specific occupations 
would be studied. 

We would score the test and code the questionnaire. Participants in the study would be 
assured that their test scores and responses would be kept totally confidential Completing the tests 
and the associated questionnaire will require 3 hours, so a break for lunch or a snack will be 
essential. Participating firms would have the following responsibilities: (1) arranging for their 
workers to take the tests and complete the questionnaire, (2) providing information on retention, 
promotion and merit pay increases of sampled workers, (3) arranging for our staff to contact the 
supervisors of the sampled workers to obtain confidential supervisory ratings. 

Company staff would administer the tests and questionnaires to new hires and send the 
completed forms in sealed envelopes to Cornell. For the job incumbents, we would arrange to 
have our staff visit the worksite to administer the test in groups of fifty or so. The confidential job 
performance assessments could be obtained either through the mail or during the visit 



CHARACTERISTICS OF THE STUDY 



In general, the characteristics of the study will be as follows: 

• Testing should be on company time, with the total time off the job not to exceed three hours. 
Voluntary testing (on the employee's own time) is generally not feasible and can seriously bias 
results. 

• The actual test administrators could be Cornell and/or local personnel; this will be resolved on 
an individual company basis. 

• The target population is locally sourced employees hired into typical entry level blue collar and 
white collar, unskilled and semi-skilled jobs, i.e., jobs for which the extent of basic lheracy 
skills might be a relevant consideration. While the most desirable sites from our perspective 
will be companies with large numbers of employees on jobs within an occupational family, we 
want to make sure that clerical employees are included in the study. 

• Evidence of validity will be developed from analysis of the relationship between test scores and 
indicators of performance. The performance measure typically will be a c onfidential rati ng by 
the employ ee's s upervisor. The rating instrument is under development ahd will be viewed 
with tfie companies prior to implementation. 

• Supervisory rating forms will be completed in group sessions conducted by researchers to 
ensure confidentiality and enhance understanding of the rating tolls and process. The rating 
process will likely require less than 10 minutes per employee evaluated, and the total time 
requirement will not exceed 2.5 hours. In the unusual case that there is more than one 
supervisor, we will need to review the situation to determine the best approach. 

• We do not anticipate a need to review company records unless there is a situation where the 
employer has actual measures of individual employee output (objective productivity measures). 
In such cases, we would like to obtain both the ratings and the output measures. 

• Actual field work could be conducted during the first quarter of 1992. 
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COURSEWARE EVALUATION 
PROCESS OVERVIEW 




300 S.W, Sixth Avenue Portland, Oregon 97204 (503) 248-6800 



The proceaa deecribed here vai detigned during the 1980-81 echool year w a fretwork 
for the evaluation of microcomputer-baaed ine tructionel materials by the MicroSlFT 
cleeringhouee. The componente axe • aat of forme, the tveluetor'e Guide . and t oecvork of 
educational ini titutione . 

T*e forma were baaed originally oo the forme developed end uaed by the CONDUIT Project for 
evaluating ccoputer-beeed ine trv ct iona 1 package* for poi t-i e condexy iuetitutione. They were 
modified with additional concept! adopted from forme developed by the orxaniiationa and 
individual. The "Coureewaxe Deacription" form identifiea tha factual information ncccaaary 
for evaluation end uae of a package, including aource, ability level, eubject, mode of 
inatructioo, required hardware end lofcwaxe, ine tructional objectiyee and prerequie i tea , 
The "Courseware Evaluation" for* ia designed to be uaed aiter the information on the 
Deecripticn for* ia available. A copy of the rating portion ia oo tha reverac of thia page. 
In addition, it providea apace for identifying major atrengthe and weaknesses, and eufcgeitione 
for potential cleasroom uaea. 

The Evaluetor* a Cuide ia a book designed to be uaed by teachera end othera who axe evaluating 
courseware for MicroSirr. It deacribea the uae of the Deacripticm end Evaluation forma, end 
providea guidelinee, euggeetione and interpre tetione of each item on the Evaluation form. 

The microSirr Network ia a group of over 20 educational organitationa aerving elementary and 
aecondary achooia with coeputer aervicea end other typei of eupport. The network includee 
• chool diatricta, regional aervice centera, atate depaxemente and atate coneortie which have 
experience in aerving local diatricta with ir.aervice, eoftwere, computer time and aervicea, 
curricula materiala and evaluation lervicee. They have ataff whoee time ia aaaigned to 
aupporting the instructional computing activitiet of echoola in their geographic area. 

The componenta Above are uaed in the three etagee of the proceaa deecrifecd below: 

1. Sifting - Thia ia a firat look at a package to determina that it ia instructional 
in nature* viil actually operate without problems oo the eppropriete microcomputer „ 
and ia complete with inatructiona . MicroSlFT ateff complete thia pheee of the proceaa. 

2. Deacription - A package paaiing atage 1 aucceaafully ia deacribed in thia ata^e uaing 
the Deacription form diacuaied above. The producer and KicroSIFT ataff complete thia 
atage for the moat part. However, aome information may be aupplied in ataga 3. 

3. Peer Review - Teachera with experience in the aubject and grade or ability level of 
the material are aclected from achooia aerved by a network aite to eveluete peckagee 
according to the Evaluation form and Evaluates 1 a Cuide . A package ia identified for 

a network aite by MicroSlFT ataff, and the teachera are aelected by the inetructional 
computing expert at the aite. Aiter the evaluationa are completed by the teachera, 
an iveluetion ia alao done by the network aite expert, who elao completes e eumnexy 
review encompassing all three evaluationa. The summery review beccnee the MicroSlFT 
evaluation of the package. 

Completion of the firat three atagca takca approximately three montha. The reeulting 
evaluationa are profeaaional opinione baaed on experience, and axe not neccsaaxily baaed 
on obaervetion of etudmt uae of the pscktget. While i omt do include auch uae, the cvaluatora 
are voluntecra, and their tioe doea not alwayi allow for extensive atudent involvement. Alao, 
e package may be evaluated at e point in the ichool yeex not in conjunction with the time the 
topic ia atudicd. 

A fourth atage of evaluation in gTeater depth ia deairablc for a om* pickages becauac of their 
complexity or breadth of curriculum coverage. Such a atage might include pre** end post-testing, 
detailed observation of etuder.t activity while uaing a package, or other proceduree. Thia 
atage ia not being implemented by KicroSIFT at thia cise, although ease approaches for it art 
being developed and invca tig jted. 
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mkr^tiFT COURSEWARE EVALUATION 



NORTHWEST REGIONAL 
EDUCATIONAL LABORATORY 



Peckege title _ 
Evetuetor name 
Dete 



Producer 



Orgentjetlon 



□ Chick this box if this evaluation is basad partly on your observation of student use of this package 



SA. Strongly Agree A-Agree D • Disagree SD • Strongly Disagree NA • Not appliceble 
Pleese include comments on individue! item* on the reverse pege* 
CONTENT CHARACTERISTICS 



(1) 


SA 


A 


D 


SD 


NA 


The content is accurate. 


(2) 


SA 


A 


D 


SD 


NA 


The content hea educational value. 


(3) 


SA 


A 


D 


SD 


NA 


The content is free of rece, ethnic, sax and other stereotypes. 


INSTRUCTIONAL CHARACTERISTICS 


(4) 


SA 


A 


D 


SO 


NA 


The purpose of the peckege is well defined. 


(5) 


SA 


A 


D 


SD 


NA 


The peckege achieves its defined purpose. 


(6) 


SA 


A 


D 


SD 


NA 


Presentation of content is clear end logical. 


(7) 


SA 


A 


D 


SD 


NA 


The level of difficulty is appropriate for the target audience. 


(8) 


SA 


A 


D 


SD 


NA 


Grephic$/color/sound are used for appropriate instructional reasons. 


[9) 


SA 


A 


D 


SD 


NA 


Use of the peckege is moti vetionai. 


(10) 


SA 


A 


D 


SD 


NA 


The peckege effectively stimulates student creativity. 


(11) 


SA 


A 


D 


SD 


NA 


Feedbeck on student responses is effectively employed. 


(12) 


SA 


A 


D 


SO 


NA 


The leemer controls the rate and sequence of presentation and review. 


(13) 


SA 


A 


D 


SD 


NA 


Instruction ts integrated with prev<ous student experience. 


(14} 


SA 


A 


D 


SD 


NA 


Learning can be generalized to an appropriate range of situations. 


TECHNICAL CHARACTERISTICS 


(15) 


SA 


A 


D 


SD 


NA 


The user support meterisls ere comprehensive. 


(16) 


SA 


A 


D 


SD 


NA 


The user support meteriels ere effective. 


(17) 


SA 


A 


D 


SD 


NA 


Informetion displays ere effective. 


(18) 


SA 


A 


D 


SD 


NA 


Intended users can easily and independently operate the program. 


(19) 


SA 


A 


D 


SD 


NA 


Teecher* cen easily employ the package. 


(20) 


SA 


A 


D 


SD 


NA 


The program appropriately uses relevant computer capabilities. 


(21) 


SA 


A 


D 


SD 


NA 


The progrem is reliable in normel use. 



QUALITY 

Write e number from 1 (low! 
to 5 {high} which represents 
your judgement of the quelity 
of the packege in each 

division: 



Content 

Instructional 
Cherecteristics 

Technical 
Characteristics 



Describe the potentiei use of the packege m ciessroom settings 



RECOMMENDATIONS 

D I highly recommend this 
package. 

O I would use or recommend 
use of this package with 
tittle or no change. (Note 
suggestions for effective 
use balow.) 

Q I would uee or recommend 
uee of thie peckege only if 
certein changes were made. 
(Note chenges under weak- 
nesses or other comments.) 

□ I would not use or recom- 
mend this package. (Note 
reesons under weaknesses.) 



Estimete the amount of time t student would need to work 
with the peckege in order to echieve the objectives: 
JCan be totel time, time per dey, time renge or other indicator. 
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ft COURSEWARE DESCRIPTION 



NORTHWEST REGIONAL 
EDUCATIONAL LABOR ATORY 



Producer , 



Vsrsion Evsluetsd, 
Cost 



fubj*ct/Topics . " " " 

Grade Levelle) (circle) pre-1 1 2 3 4 5 9 7 • 9 10 11 12 post-secondery 

Required Hard we re — : ! 

Required Software ■ ' 

Mm protected? Dy Ono Mtdium of Transfer; DT.p. Csssett. QbOM Cartridge Qf Fl.xibl. Disk □ Flexible Disk 



lack Up Policy - 



Producer's field teet dete If evailable Don request Qwith packsgs Qnot evstlebls 



INSTRUCTIONAL PURPOSES & TECHNIQUES 
pf chtck til epplicebte 

□ Remedletion QTutori el 

□ Standard instruction □information retrieval 



□ Enrichment 

□ Aseeesmsnt 

□ instructional 
msnegsment 

□ Authoring 

□ Drill and practice 



□ Game 

□ Simulation 

□ Problem Solving 

□ Other 



DOCUMENTATION AVAILABLE 

circle P (progrim) S (supplsm'jntarY mstsrls!) 

P S Tsacher's Information 



P S Suggested grade/ sbility laval(a) 

P S Inetructionel objectivee 

P S Prerequisite skills or activities 

P S Sample program output 

P S Program operating instructions 

P S Pre-tast 

P S Post*test 



P S Resource/reference information 

P S Student' e instructions 

P S Student worksheets 

P $ Textbook correction 

P S Follow-up ectivities 

P S Other 



MUECTIVES DSiatsd □inferred 



PREREQUISITES Dsteted □inferred 



Describe; packege CONTENT AND STRUCTURE, including record keeping and reporting functions 
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WORKPLACE EDUCATION 
Teacher Observation Checklist 

I. THE INSTRUCTOR DEMONS'^ .tATES AUTHENTICITY AND CREDIBILITY. 



indicators Yes N/O Comments 



Demonstrates command of 
subject 








Acknowledges students 1 
Knowledge ana experience 
about the course content 








Snows a willingness uo 
admit errors in front of 
students 








Shows a willingness to 
communicate feelings or to 
reveal tne personal siae ox 
self, as appropriate 








Speaks in a clear, audible 
voice 








Uses appropriate vocabulary level 
and detail of explanation m ciass 








Provides assistance and/or 
positive reinforcement 








Accommodates a variety of abilities 
in a multi-level class 








Designs varied instructional format 

+-o ^ r , r , mnTnnH TTltlltiDle leaminCT 

styles 








Responds appropriately to student 
comments 








Uses appropriate questions-open, 
closed, directed? 








Distributes questions evenly among 
students 








Rephrases, redirects, defers 
questions 









Instructional component, cont. 

Yes N/0 Comments 



Manages transitions between 
learning activities smoothly 








Allows ample time for students 
to apply listeria! presented 








Uses appropriate illustrations, 
visuals, etc. 








Relates new learning to prior 
learning 








Uses materials which are 
relevant to program goals 








Encourages collaborative 
learning 








Incorporates group projects 
or team presentations 


- - 






Works jointly with students 
in decision-making processes 








II. FEEDBACK AND EVALUATION 

The instructor provides 
effective feedback and 
methods of evaluation 








Dmvi Hoc t* "inipl v "i nd "i v iduallv 
affirming feedback to students 








Solicits feedback regularly 
from students regarding his 
teaching style 








Creates sense that the learners 
are in control of their outcomes 









III. COMMENTS 



EmployUutxt - EmpJTabe 

The data in employta.txt is the listing of the first and second round tabe scores. 
Some rows are complete, meaning that the individual has social security number, two sets 
of TABE scores and pre- and post- test scores that coincide with courses one and two in the 
classes.txt data. Some rows have * in the locator column indicating that the individual did 
not TABE and will only have pre- and post-test scores. Also the individuals from Elkem 
have not been re-TABE-ed yet. The abbreviations are as follows: 



ssocial 
frname 
lname 
r locate 



r_ss 
r _perc 
r_stan 
r_ge 

mjocate 

m_ss 

mjperc 

m_stan 

m_ge 

TALS D 

TALS Q 

TALS D2 

TALS Q2 

company 

r_ss_2 

rjperc_2 

r_stan_2 

m_ss_2 

mjperc__2 

m_stan_2 

m_ge_2 

pre__tl 

post_tl 

pre_t2 

post_t2 

compel 

comp_2 



social security number 
first name 
last name 

reading locator the individual tested from 
(A, D, E, or M) 

it is .possible to have two different locators; one for reading 
and one for math 

reading standard score - first TABE 

reading percentage - first TABE 

reading stanine level - first TABE 

reading grade equivalent - first TABE 

math locator the individual tested from 

math standard score - first TABE 

math percentage - first TABE 

math stanine level - first TABE 

math grade equivalent - first TABE 

TALS Derivitive Score - first round 

TALS Quantitative Score - first round 

TALS Derivitive Score - second round 

TALS Quantitative Score - second round 

company individual works for 

reading standard score - Re-TABE 

reading percentage - Re-TABE 

reading stanine level - Re-TABE 

reading grade equivalent - Re-TABE 

math standard score - Re-TABE 

math percentage - Re-TABE 

math stanine level - Re-TABE 

math grade equivalent - Re-TABE 

pre-test score for the first class in percent form 

post-test score for the first class in percent form 

pre-test score for the second class in percent form 

post-test score for the second class in percent form 

difference between pre and post test 1 (for most individuals 

difference between pre and post test 2 this is incomplete) 



Wesscores.txt - Wes 

The wesscores.txt contains data from the wes table. The hard copy is sorted by 
company and then ascendinc social security numLers within the company. It is possible for 
an individual to have only o~ne set of scores. An individual who has not taken one of the 
rounds of WES testing will have N/As in the columns. The abbreviations are as follows: 



company 


= 


company individual works for 


social 


= 


social security number 


i_r 




involvement - raw score 


pc_r 




peer cohesion - raw score 


ss_r 


— 


supervisor support - raw score 


a__r 


— - 


autonomy - raw score 


to_r 


= 


task orientation - raw score 


wp_r 




work pressure - raw score 


c_r 


— 


clarity - raw score 


ctl_r 




control - r<iw score 


innjr 




innovation - raw score 


com_r 




physical comfort - raw score 


L s 




involvement - scale score 


pc_s 




peer cohesion - scale score 


ss_s 




supervisor support - scale score 


a_s 




autonomy - scale score 


to_s 




task orientation - scale score 


wp s 




work pressure - scale score 


c_s 




clarity - scale score 


ctl s 




control - scale score 


inn_s 




innovation - scale score 


com s 




physical comfort - scale score 



The following abbrevations with _r2 and _s2 are for the second round of scores. The 
abbreviations beyond those that end with _c and _cs were set up for composite scores but 
never used. 



ore 
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FILE: NWLPDATA, 
LABEL: NONE 

VARIABLE NAMES : 



NO. OF VARIABLES: 78, NO. OF CASES: 388 



1 . 


ssnuiuber 


2 . 


company 


3. 


race 


4. 


veteran 


5. 


us_cit 


6 . 


sex 


7 . 


age 


8. 


education 


9. 


language 


10. 


yrson job 


11 . 


r locate 


12. 


r_ss 


13. 


rjperc 


14. 


r_stan 


15. 


r_ge 


16 . 


m locate 


17. 


m_ss 


18. 


iu perc 


19. 


m_stan 


20. 


m_ge 


21 . 


tals_d 


22. 


tals_q 


23. 


tals_d2 


24. 


tals_q2 


25. 


r_ss2 


26. 


r_perc2 


27. 


r_stan2 


28. 


rjge2 


29. 


rn._ss2 


30. 


m_perc2 


31. 


m_stan2 


32. 


m_ge2 


33. 


pre_tl 


34. 


post_tl 


35. 


pre_t2 


36. 


post_t2 


37. 


compel 


38. 


comp_2 


39. 




40. 


pc_r 


41. 


ss_r 


42. 


a_r 


43. 


to_r 


44. 


wp_r 


45. 


c__r 


46. 


ctl_r 


47. 


inn_r 


48. 


com_r 


49. 




50. 


pc_s 


51. 


ss_s 


52. 


a_s 


53. 


to_s 


54. 


wp s 


55. 


c_s 


56. 


ctl_s 


57. 


inn_s 


58. 


cora_s 


59. 


i_r2 


60. 


pc__r2 


61. 


ss_r2 


62. 


a__r2 


63. 


to_r2 


64. 


wp_r2 


65. 


c__r2 


66. 


ctl_r2 


67. 


inn_r2 


68. 


com_r2 


69. 


i_s2 


70. 


pc_s2 


71. 


ss__s2 


72. 


a_s2 


73. 


to_s2 


74. 


wp_s2 


75. 


c_s2 


76. 


ctl_s2 


77. 


inn_s2 


78. 


com_s2 
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FILE: NWLPDATA, NO. OF VARIABLES: 78, NO. OF CASES: 320 (MISS. CASES: 0) 
LABEL : NONE 

• 

SUMMARY STATISTICS 









ssnumber 




company 




race 




veteran 


Mean 


= 


2. 


85298E8 


2. 


07668 


1. 


33333 


0. 


984375 


Maximum 


= 


5. 


87106E8 


3 




5 




1 




Minimum 


= 


0. 


00000E0 


1 




1 




0 




Range 


= 


5. 


87106E8 


2 




4 




1 




Valid Observations 


= 


3. 


20000E2 


313 




318 




64 




Missing Values 


= 


0. 


00000E0 


7 




2 




256 




Sample Standard Dev. 


= 


6. 


64818E7 


0. 


716472 


0. 


622062 


0. 


125 


Sample Variance 


= 


4. 


41983E15 


0. 


513333 


0. 


386961 


0. 


015625 


Sample Coef. Of Var. 


= 


2. 


33026E-1 


0. 


345009 


0. 


466546 


0. 


126984 


Standard Error Of Mean 


= 


3. 


71645E6 


0. 


.0404974 


0. 


0348835 


0. 


015625 


Median 


= 


2. 


84324E8 


2 




1 




1 




First Quartile 


= 


2. 


73558E8 


2 




1 




1 




Third Quartile 


= 


2. 


95657E8 


3 




2 




1 




Interquartile Range 


= 


2. 


20983E7 


1 




1 




0 




Lower Adjacent Value 


= 


2 


.44781E8 


1 




"k-k-k-k-k-k-k^c-k-k-k 


*********** 


Upper Adjacent Value 


= 


3 


.03527E8 


•k-k-k-k-k-k-k-k-k-k^k^k 


3 




*********** 


Minor Outliers 


= 


2 


.20000E1 


0 




6 




0 




Major Outliers 


= 


4 


.90000E1 


0 




0 




1 




Standard Deviation 


= 


6 


.63779E7 


0 


.715327 


0 


.621083 


0 


.12402 


Variance 




4 


.40602E15 


0 


.511692 


0 


.385744 


0 


.0153809 


| Coefficient Of Var. 




2 


. 32662E-1 


0 


.344457 


0 


.465812 


0 


.125988 


* Sum 




9 


.12953E10 


650 




424 




63 




Sum Of Squares 




2 


.74563E19 


1510 




688 




63 




Sum Of Squared Dev. 




1 


.40993E18 


160 


. 16 


122 


.667 


0 


.984375 


Second Moment 




4 


.40602E15 


0 


.511692 


0 


.385744 


0 


.0153809 


Third Moment 




1 


.20194E23 


-0 


.0414791 


0 


.627533 


-0 


.0149002 


Fourth Moment 




2 


.15135E32 


0 


.512209 


1 


.8812 


0 


.0146711 


Coefficient Of Skewness 




4 


.10974E-1 


-0 


. 113322 


2 


.61931 


-7 


.81127 


Coefficient Of Kurtosis 




1 


.10820E1 


1 


.95627 


12 


.6426 


62 


.0159 
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FILE: NWLPDATA, 
BEL: NONE 



NO. OF VARIABLES: 78, NO. OF CASES: 320 (MISS. CASES: 0) 



SUMMARY STATISTICS 



sex 



age 



education 



language 



Mean 
Maximum 
Minimum 
Range 

Valid Observations 
Missing Values 
Sample Standard Dev. 

Sample Variance 
Sample Coef . Of Var. 
Standard Error Of Mean 

Median 
First Quartile 
Third Quartile 
Interquartile Range 
Lower Adjacent Value 
Upper Adjacent Value 
Minor Outliers 
Major Outliers 
Standard Deviation 
Variance 
Coefficient Of Var. 

Sum 

Sum Of Squares 
Sum Of Squared Dev. 

Second Moment 
Third Moment 
Fourth Moment 
Coefficient Of Skevmess 
Coefficient Of Kurtosis 



1.6913 2. 

2 5 

1 0 

1 5 
230 230 

90 90 

0.462963 1. 

0.214335 1. 

0.273731 0. 

0.0305269 0. 

2 3 

1 2 

2 4 
1 2 

ic ic 1c 1c ick ick & ick Q 

ic ic ic ick ic ick ick ic 5 

0 0 

0 o 

0.461955 1. 

0.213403 1. 

0.273135 0. 

389 657 

707 2173 

49.0826 296. 

0.213403 1. 

-0.0816497 0. 

0.0767806 4, 

-0.828238 0, 

1.68598 2 



85652 



13742 
29373 
398185 
0749996 



13495 
28811 
397319 



265 

28811 

126966 

0916 

0868477 

46597 



3. 
6 
0 
6 

231 
89 
1 . 
2. 
0. 
0. 
4 
1 
4 
3 
0 
6 
0 
0 

1 . 
2. 
0. 

733 
2975 
649 . 
2. 
-2. 
15. 
-0. 
1 . 



17316 



6799 
82206 
529409 
110529 



67626 
80984 
528262 



074 

80984 

43455 

5522 

516887 

96982 



1 .0524 

2 

1 

1 

229 
91 

0.223324 

0.0498736 

0.212204 

0.0147577 

1 

1 

1 

0 

ick'k'k'k'k'k'k'k'k'k 
icickicicicicicicicic 

o 

12 

0.222836 

0.0496558 

0.21174 

241 

265 
11.3712 
0.0496558 
0.0444517 
0.0422587 
4.01729 
17.1386 
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FILE: NWLPDATA, 
BEL : NONE 



NO. 



OF VARIABLES: 78, NO. OF CASES: 320 (MISS. CASES: 0) 



Mean : 
Maximum : 
Minimum 
Range 

Valid Observations 
Missing Values 
Sample Standard Dev. 

Sample Variance 
Sample Coef . Of Var. 
Standard Error Of Mean 

Median 
First Quartile 
Third Quartile 
Interquartile Range 
Lower Adjacent Value 
Upper Adjacent Value 
Minor Outliers 
Major Outliers 
Standard Deviation 
Variance 
Coefficient Of Var. 

Sum 

Sum Of Squares 
Sum Of Squared Dev. 

Second Moment 
Third Moment 
Fourth Moment 
Coefficient Of Skewness 
Coefficient Of Kurtosis 



SUMMARY STATISTICS 



yrsonj ob 



r locate 



r ss 



r-perc 



10. 
42 

0 
42 
229 
91 

7. 
58. 

0 . 

0 . 

9 

5 
15 
10 

0 
29 

1 

0 

7. 
58. 

0 

2498 
40600 
13351 
58 
402 
11576 
0 
3 



9083 



65228 
5573 
70151 
505677 



63555 

3016 

699976 



1 

3016 
359 

903842 
40563 



2.58654 

4 

0 

4 

312 
8 

1.34865 

1.81885 

0 .521411 

0.0763522 

2.5 

1 

4 

3 

0 

************ 

0 
0 

1.34649 
1.81302 
0.520574 
807 
2653 
565 .663 
1.81302 
-0.478549 

4.84214 
-0.196029 
1.47309 



7.64661E2 
8.44000E2 
4.13000E2 
4.31000E2 
3.04000E2 
1.60000E1 
5.78096E1 
3.34195E3 
7.56016E-2 
3.31561E0 
7.77000E2 
7.50000E2 
8 .02000E2 
5 .20000E1 
6.77000E2 
8 .44000E2 
1.50000E1 
6.00000E0 
5 .77144E1 
3.33095E3 
7.54771E-2 
2.32457E5 
1 .78763E8 
1 .01261E6 
3 . 33095E3 
-4.60204E5 
1 .24720E8 
-2.39385E0 
1. 12409E1 



7.30789E1 
9 .90000E1 
1.00000E0 
9.80000E1 
3.04000E2 
1.60000E1 
2 .73030E1 
7.45452E2 
3 .73609E-1 
1.56593E0 
8 .30000E1 
5 .90000E1 
9 .50000E1 
3.60000E1 
5.00000E0 
9 .90000E1 
8.00000E0 
0.00000E0 
2.72580E1 
7.43000E2 
3.72994E-1 
2.22160E4 
1.84939E6 
2.25872E5 
7.43000E2 
-2.29294E4 
1.77305E6 
-1.13217E0 
3.21177E0 



BEST COPY AVAILABLE 



ERIC 



302 



- 4 - 



FILE: NWLPDATA, 
^^BEL : NONE 



NO. OF VARIABLES: 78, NO. OF CASES: 320 (MISS. CASES: 0) 



SUMMARY STATISTICS 









r_stan 




r_ge 


m_locate 




m_ss 


Mean 


= 


6. 


60726 


9. 


75987 


2 . 


79553 


7. 


65026E2 


Maximum 


= 


9 




13 




4 




8. 


61000E2 


Minimum 


= 


1 




2 




0 




4. 


66000E2 


Range 


= 


8 




11 




4 




3 . 


95000E2 


Valid Observations 


= 


303 




304 




313 




3. 


04000E2 


Missing Values 


= 


17 




16 




7 




1 . 


60000E1 


Sample Standard Dev. 


= 


2. 


03469 


3. 


08273 


1. 


29955 


5. 


27453E1 


Sample Variance 


= 


4. 


13995 


9. 


5032 


1 . 


68883 


2 . 


78207E3 


Sample Coef. Of Var. 


= 


0. 


'307947 


0. 


315857 


0. 


464867 


6. 


89457E-2 


Standard Error Of Mean 


= 


0. 


11689 


0. 


176806 


0. 


0734548 


3. 


02515E0 


Median 


= 


7 




11 




3 




7. 


70000E2 


First Quartile 


= 


5 




8 




2 




7. 


44500E2 


Third Quartile 


= 


8 




12 


.5 


4 




7. 


95500E2 


Interquartile Range 


= 


3 




4 


.5 


2 




5 . 


10000E1 


Lower Adjacent Value 


= 


1 




2 




0 




6. 


71000E2 


Upper Adjacent Value 


= 


9 




13 




'k'k'k'kii'k'k'k'k'k'k'k 


8. 


61000E2 


Minor Outliers 


= 


0 




0 




0 




8. 


00000E0 


Major Outliers 


= 


0 




0 




0 




4. 


.00000E0 


Standard Deviation 




2 


.03133 


3 


.07765 


l 


.29747 


5 . 


26585E1 


& Variance 




4 


.12628 


9 


.47194 


l 


.68343 


2. 


.77291E3 


™ Coefficient Of Var. 




0 


.307438 


0 


.315337 


0 


.464124 


6 


.88322E-2 


Sum 




2002 




2967 




875 




2 


. 32568E5 


Sum Of Squares 




14478 




31837 




2973 




1 


.78764E8 


Sum Of Squared Dev. 




1250 


.26 


2879 


.47 


526 


.914 


8 


.42966E5 


Second Moment 




4 


.12628 


9 


.47194 


1 


.68343 


2 


.77291E3 


Third Moment 




-7 


.11406 


-26 


. 6199 


-1 


.06104 


-2 


.71658E5 


Fourth Moment 




53 


.1829 


260 


.272 


4 


.919 


8 


.06226E7 


Coefficient Of Skewness 




-0 


.848749 


-0 


.91316 


-0 


.485779 


-1 


.86045E0 


Coefficient Of Kurtosis 




3 


. 12359 


2 


.90101 


1 


.73575 


1 


. 04854E1 



BEST COPY AVAILABLE 



o 

ERIC 



- 5 - 



FILE: NWLPDATA, NO. OF VARIABLES: 78, NO. OF CASES: 320 (MISS. CASES: 0) 
ABEL : NONE 



SUMMARY STATISTICS 







m__perc 




m_stan 




m_ge 




tals_d 


Mean = 


6. 


67105E1 


6. 


18812 


8. 


62928 


2. 


86000E2 


Maximum = 


9. 


90000E1 


9 




12. 


9 


3 


.50000E2 


Minimum = 


1. 


00000E0 


1 




1 . 


4 


2 


.00000E2 


Range = 


9 . 


80000E1 


8 




11 . 


5 


1 


. 50000E2 


Valid Observations = 


3. 


04000E2 


303 




304 




3 


. 50000E1 


Missing Values = 


1. 


60000E1 


17 




16 




2 


. 85000E2 


Sample Standard Dev. = 


2. 


83948E1 


2 . 


05574 


2 


. 76967 


4 


. 36699E1 


Sample Variance = 


8. 


06266E2 


4. 


22608 


7 


. 67105 


1 


. 90706E3 


Sample Coef. Of Var. = 


4. 


25642E-1 


0. 


332208 


0 


.320962 


1 


. 52692E-1 


Standard Error Of Mean = 


1. 


62855E0 


0 


. 118099 


0 


.158851 


7 


. 38156E0 


Median = 


7. 


50000E1 


6 




8 


. 4 


2 


. 90000E2 


First Quartile = 


4. 


60000E1 


5 




6 


.8 


2 


.60000E2 


Third Quartile = 


9. 


20000E1 


8 




10 


. 9 


3 


. 20000E2 


Interquartile Range = 


4. 


60000E1 


3 




4 


. 1 


6 


. 00000E1 


Lower Adjacent Value = 


1. 


00000E0 


1 




1 


.4 


2 


.00000E2 


Upper Adjacent Value = 


9 . 


90000E1 


9 




12 


.9 


3 


. 50000E2 


Minor Outliers = 


0. 


00000E0 


0 




0 




0 


.00000E0 


Major Outliers = 


0. 


00000E0 


0 




0 




0 


. 00000E0 


Standard Deviation = 


2. 


83481E1 


2 


. 05235 


2 


. 76511 


4 


. 30415E1 


^ Variance = 


8. 


03614E2 


4 


.21214 


7 


. 64582 


1 


.85257E3 


™ Coefficient Of Var. = 


4. 


24942E-1 


0 


.33166 


0 


.320433 


1 


.50495E-1 


Sum = 


2. 


02800E4 


1875 




2623 


.3 


1 


.00100E4 


Sum Of Squares = 


1. 


59719E6 


12879 




24961 


.5 


2 


.92770E6 


Sum Of Squared Dev. = 


2. 


44299E5 


1276 


. 28 


2324 


.33 


6 


.48400E4 


Second Moment = 


8 


.03614E2 


4 


.21214 


7 


.64582 


1 


.85257E3 


Third Moment = 


-1 


.55652E4 


-3 


. 66103 


-2 


.82488 


-1 


.68480E4 


Fourth Moment = 


1 


.47126E6 


44 


.4434 


140 


.563 


7 


.06261E6 


Coefficient Of Skewness = 


-6 


.83256E-1 


-0 


.423497 


-0 


.133618 


-2 


. 11293E-1 


Coefficient Of Kurtosis = 


2 


.27821E0 


2 


.50497 


2 


.40448 


2 


.05786E0 




- 6 - 



FILE: NWLPDATA, NO. OF VARIABLES: 78, NO. OF CASES: 320 (MISS. CASES: 0) 
^VBEL: NONE 



SUMMARY STATISTICS 







tals_q 




tals_d2 




tals_q2 




r_ss2 


Mean = 


2. 


97143E2 


2. 


97826E2 


3. 


07826E2 


7 . 


67418E2 


Maximum = 


3. 


70000E2 


3 . 


70000E2 


3. 


80000E2 


8. 


44000E2 


Minimum = 


2. 


00000E2 


1 . 


90000E2 


1 . 


80000E2 


0. 


00000E0 


Range = 


1. 


70000E2 


1 . 


80000E2 


2. 


00000E2 


8. 


44000E2 


Valid Observations = 


3. 


50000E1 


2 . 


30000E1 


2. 


30000E1 


1 . 


65000E2 


Missing Values = 


2. 


85000E2 


2. 


97000E2 


2. 


97000E2 


1 . 


55000E2 


Sample Standard Dev. = 


4. 


31530E1 


3. 


72896E1 


4. 


79542E1 


7. 


67233E1 


Sample Variance = 


1 . 


86218E3 


1 . 


39051E3 


2. 


29960E3 


5. 


88646E3 


Sample Coef. Of Var. = 


1. 


45227E-1 


1. 


25206E-1 


1. 


55783E-1 


9 . 


99759E-2 


Standard Error Of Mean = 


7. 


29420E0 


7. 


77542E0 


9 . 


99914E0 


5. 


97290E0 


Median = 


3. 


00000E2 


3 . 


00000E2 


3. 


10000E2 


7. 


83000E2 


First Quartile = 


2. 


65000E2 


2. 


80000E2 


2. 


80000E2 


7 . 


54000E2 


Third Quartile = 


3. 


35000E2 


3. 


30000E2 


3. 


35000E2 


8 


.02000E2 


Interquartile Range = 


7 


.00000E1 


5 


.00000E1 


5. 


50^00E1 


4 


. 80000E1 


Lower Ad j acent Value = 


2 


.00000E2 


2 


.50000E2 


2. 


10000E2 


6 


.91000E2 


Upper Adjacent Value = 


3 


.70000E2 


3 


.70000E2 


3 


. 80000E2 


8 


.44000E2 


Minor Outliers = 


0 


.00000E0 


1 


.00000E0 


1 


.00000E0 


8 


.00000E0 


Major Outliers = 


0 


.00000E0 


0 


.00000E0 


0 


.00000E0 


3 


.00000E0 


Standard Deviation = 


4 


.25321E1 


3 


.64699E1 


4 


.69001E1 


7 


. 64904E1 


■ Variance = 


1 


.80898E3 


1 


.33006E3 


2 


.19962E3 


5 


.85079E3 


Coefficient Of Var. = 


1 


.43137E-1 


1 


.22454E-1 


1 


. 52359E-1 


9 


.96724E-2 


Sum = 


1 


.04000E4 


6 


.85000E3 


7 


.08000E3 


1 


.26624E5 


Sum Of Squares = 


3 


. 15360E6 


2 


.07070E6 


2 


.23000E6 


9 


.81389E7 


Sum Of Squared Dev. = 


6 


.33143E4 


3 


.05913E4 


5 


.05913E4 


9 


.65380E5 


Second Moment = 


1 


.80898E3 


1 


.33006E3 


2 


.19962E3 . 


5 


.85079E3 


Third Moment = 


-2 


.70997E4 


-3 


.71850E4 


-8 


.47313E4 


-2 


. 89864E6 


Fourth Moment = 


8 


.32391E6 


7 


. 81239E6 


1 


.89082E7 


2 


. 14002E9 


Coefficient Of Skewness = 


-3 


.52220E-1 


-7 


.66589E-1 


-8 


.21338E-1 


-6 


.47699E0 


Coefficient Of Kurtosis = 


2 


. 54366E0 


4 


.41615E0 


3 


.90800E0 


6 


.25158E1 



o 



G5 



ERIC 



- 7 - 



FILE: 
ABEL : 



NWLPDATA, 
NONE 



NO. OF VARIABLES: 78, NO. OF CASES: 320 (MISS. CASES: 0) 







SUMMARY 


STATISTICS 














r_perc2 


T" 


cf an? 

O L-CU-l^L. 




r_ge2 




m_ss2 


Mean = 


7 . 


59363E1 


a 

D • 


ft CiftQ 


9 . 


87866 


7 . 


71655E2 


Maximum = 


9 . 


90000E1 


Q 




12 . 


9 


o 

8 . 


63000E2 


Minimum = 


1 . 


00000E0 


1 

X 




1 . 


9 


4 . 


66000E2 


Range = 


9 . 


80000E1 


8 




11 




3 . 


97000E2 


Valid Observations = 


1 . 


57000E2 


163 

1 U J 




1 C A 

164 




1 . 


/- q n n n "c* n 
DO000E2 


Missing Values = 


1 . 


.63000E2 


1 R7 




156 




1 . 


CI AAAr«o 

52000E2 


Sample Standard Dev. = 


2 . 


59362E1 


1 

-L • 


U J J *T 


Z 


. ou Zoo 


D . 


n *7 1 QQrl 

u / iy oki 


Sample Variance = 


6 


. 72688E2 


9 

O ■ 


J u o o u 


1 


. 85 3 35 


z , 


b / ZbUh*o 


Sample Ccaf. Of Var. = 


3 


. 41552E-1 


LI ■ 




0 


*") Q *D £ Q 
. ZOJDO 


b . 


b / Zo /H— z 


Standard Error Of Mean = 


2 


.06994E0 


A 

\J a 


1*1 J / DO 




1 i none 

. 218829 


3 


A1 o -t npA 

. y ioizh*u 


Median = 


8 


.70000E1 


7 




10 


. 9 


7 


. 76000E2 


First Quartile = 


6 


. 10000E1 


a 
o 




8 


*-> 
. 2 


7 


. 47000E2 


Third Quartile = 


9 


.50000E1 


Q 

o 




11 


. 9 


8 


. 03000E2 


Interquartile Range = 


3 


. 40000E1 


9 

£-> 




3 


. 7 


5 


. 60000E1 


Lower Adjacent Value = 


1 


.30000E1 


9 
«J 




2 


. 8 


6 


. 70000E2 


Upper Adjacent Value = 


9 


.90000E1 


Q 




12 


i-S 

. 9 


o 
o 


A A An 

. O3000E2 


Minor Outliers = 


3 


.00000E0 


z. 




2 




2 


. UUUUUh,U 


Major Outliers = 


0 


.00000E0 


0 




0 




2 


. 00000E0 


Standard Deviation = 


2 


. 58535E1 


i 


. 82981 


2 


.79383 


b 


. 0bbo7El 


^ Variance = 


6 


. 68404E2 


3 


.34819 


7 


.80546 


2 


r CHI OT7 *D 

. bb / lyiio 


" Coefficient Of Var. = 


3 


.40463E-1 


0 


.266778 


0 


. 282814 


b 


. bboZoh*— Z 


Sum = 


1 


. 19220E4 


1118 




i £ *5 n 


i 

. i 


i 


• Z. JOEij 


Sum Of Squares = 


1 


.01025E6 


8214 




17284 


.5 


i 


.00465E8 


Sum Of Squared Dev. = 


1 


.04939E5 


545 


.755 


1280 


.1 


4 


.29608E5 


Second Moment = 


6 


. 68404E2 


3 


.34819 


7 


.80546 


2 


.55719E3 


Third Moment = 


-2 


. 11033E4 


-4 


.57372 


-21 


.5352 


-2 


.37183E5 


Fourth Moment = 


1 


.51116E6 


34 


.0304 


192 


.381 


7 


.26263E7 


Coefficient Of Skewness = 


-1 


.22121E0 


-0 


.746544 


-0 


.987532 


-1 


.83417E0 


Coefficient Of Kurtosis = 


3 


.38246E0 


3 


.03562 


3 


.15766 


1 


. 11063E1 



ERIC 



o n r 



- 8 - 



FILE: NWLPDATA, 
BEL : NONE 



NO. OF VARIABLES: 78, NO. OF CASES: 320 (MISS. CASES: 0) 



SUMMARY STATISTICS 







m perc2 


m 


i_stan2 




m_ge2 




pre_tl 


Mean = 


6. 


99688E1 


6. 


54167 


9. 


08929 


39. 


6651 


Maximum = 


9. 


90000E1 


9 




13 




86 




Minimum = 


1. 


00000E0 


1 




1 




0 




Range = 


9 . 


80000E1 


8 




12 




86 




Valid Observations = 


1 . 


60000E2 


168 




168 




215 




Missing Values = 


1 . 


60000E2 


152 




152 




105 




Sample Standard Dev. = 


2. 


82997E1 


1. 


99956 


2. 


84496 


20. 


4594 


Sample Variance = 


8. 


00873E2 


3. 


99825 


8. 


09378 


418. 


588 


Sample Coef. Of Var. = 


4. 


04462E-1 


0. 


305666 


0 . 


313001 


0. 


515804 


Standard Error Of Mean = 


2. 


23729E0 


0. 


15427 


0 . 


219493 


1. 


39532 


Median = 


7. 


95000E1 


7 




9 




40 




First Quartile = 


4. 


75000E1 


5 




7 




25 




Third Quartile = 


9 . 


50000E1 


8 




11 




55 




Interquartile Range = 


4. 


75000E1 


3 




4 




30 




Lower Adjacent Value = 


1 


.00000E0 


1 




1 




0 




Upper Adjacent Value = 


9 


.90000E1 


9 




13 




86 




Minor Outliers = 


0 


.00000E0 


0 




0 




0 




Major Outliers = 


0 


.00000E0 


0 




0 




0 


.4118 


Standard Deviation = 


2 


.82111E1 


1 


.9936 


2 


.83648 


20 


Variance = 


7 


.95868E2 


3 


.97445 


8 


.0456 


416 


.641 


^ Coefficient Of Var. = 


4 


.03196E-1 


0 


.304755 


0 


.312068 


0 


.514603 


Sum = 


1 


. 11950E4 


1099 




1527 




8528 




Sum Of Squares = 


9 


. 10639E5 


7857 




15231 




427842 




Sum Of Squared Dev. = 


1 


.27339E5 


667 


.708 


1351 


.66 


89577 


.9 


Second Moment = 


7 


.95868E2 


3 


.97445 


8 


.0456 


416 


.641 


Third Moment = 


: -1 


. 67007E4 


-3 


. 6114.', 


-5 


.5665 


-342 


.072 


Fourth Moment = 


1 


.45293E6 


37 


.9385 


149 


.8 


396748 




Coefficient Of Skewness = 


: -7 


.43830E-1 


-0 


.455792 


-0 


.243918 


-0 


.0402229 


Coefficient Of Kurtosis = 


2 


.29384E0 


2 


.40173 


2 


.31416 


2 


.28555 



9 

ERIC 



367 



- 9 - 



# 



FILE: 
BEL: 



NWLPDATA , 
NONE 



NO. OF VARIABLES: 78, NO. OF CASES: 320 (MISS. CASES: 0) 



SUMMARY STATISTICS 







post_tl 




pre_t2 


post_t2 


Mean = 


6. 


51897E1 


43. 


4894 


73 . 


4776 


Maximum = 


1 . 


00000E2 


75 




100 




Minimum = 


0. 


00000E0 


0 




0 




Range = 


1 . 


00000E2 


75 




100 




Valid Observations = 


1. 


95000E2 


141 




134 




Missing Values = 


1. 


25000E2 


179 




186 




Sample Standard Dev. = 


2. 


64778E1 


15. 


0697 


70 


0157 


Sample Variance = 


7. 


01072E2 


227. 


095 


400 . 


627 


Sample Coef. Of Var. = 


4. 


06165E-1 


0 . 


346514 


0 . 


272405 


Standard Error Of Mean = 


1 


.89611E0 


1. 


26909 


1 , 


72909 


Median = 


7 


.10000E1 


44 




78 




First Quartile = 


5 


.00000E1 


33 




64 




Third Quartile = 


8 


.45000E1 


54 




89 




Interquartile Range = 


3 


.45000E1 


21 




25 




Lower Adjacent Value = 


0 


.00000E0 


9 




29 




Upper Adjacent Value = 


1 


.00000E2 


75 




100 




Minor Outliers = 


0 


.00000E0 


1 




4 




Major Outliers = 


0 


.00000E0 


0 




0 




Standard Deviation = 


2 


.64098E1 


15 


.0161 


19 


.9409 


& Variance = 


6 


.97477E2 


225 


.484 


397 


.638 


^ Coefficient Of Var. = 


4 


.05122E-1 


0 


. 345283 


0 


.271387 


Sum = 


1 


.27120E4 


6132 




9846 




Sum Of Squares = 


9 


.64700E5 


298470 




776744 




Sum Of Squared Dev. = 


1 


.36008E5 


31793 


.2 


53283 


.4 


Second Moment = 


6 


.97477E2 


225 


.484 


397 


.638 


Third Moment = 


-1 


.81027E4 


-573 


.934 


-11423 


.8 


Fourth Moment = 


1 


. 68187E6 


138956 




886382 




Coefficient Of Skewness = 


-<1 


.82762E-1 


-0 


. 169507 


-1 


.44072 


Coefficient Of Kurtosis = 


3 


.45726E0 


2 


.73305 


5 


.60591 



ERIC 



?> f > 8 



- 10 - 



m 



FILE: NWLPDATA, 
BEL : NONE 



NO. OF VARIABLES: 78, NO. OF CASES: 320 (MISS. CASES: 0) 



Mean 
Maximum 
Minimum 
Range 

Valid Observations 
Missing Values 
Sample Standard Dev. 

Sample Variance 
Sample Coef. Of Var. 
Standard Error Of Mean 

Median 
First Quartile 
Third Quartile 
Interquartile Range 
Lower Adjacent Value 
Upper Adjacent Value 
Minor Outliers 
Major Outliers 
Standard Deviation 
Variance 
Coefficient Of Var. 

Sum 

Sum Of Squares 
Sum Of Squared Dev. 

Second Moment 
Third Moment 
Fourth Moment 
Coefficient Of Skewness 
Coefficient Of Kurtosis 



SUMMARY STATISTICS 



comp_l 



comp_2 



pc_r 



-16. 

37 
-56 
93 
62 
258 

19. 
372. 
-1. 
2. 
-18. 
-32 
0 
32 
-56 
37 
0 
0 
19 . 
366. 
-1 . 
-1010 
39170 
22716, 
366 
3855 
412618 
0 
3 



2903 



2978 

406 

18462 

45083 

5 



1416 
4 

17503 



8 
4 

08 

549669 
07353 



-25. 

31 
-60 

91 

40 
280 

16. 
277. 

-0. 
2. 
-28 
-32 
-20 

12 
-47 
-12 
2 
2 

16. 
270. 
-0, 
-1003 
35961 
10810 
270 
7232 
539438 
1 
7 



075 



6493 
199 
66398 
63249 



4399 
269 

655628 



8 

269 
54 

62778 
38495 



3. 

9 
0 
9 

294 
26 
2. 
6. 
0. 
0. 
3 
1 
6 
5 
0 
9 
0 
0 
2. 
6. 
0 . 
1050 
5720 
1970 
6. 
7. 
96 
0 
2 



57143 



59298 
72355 
726035 
151226 



58857 
70068 
724799 



70068 

04082 

1892 

405924 

14234 



4. 

9 
0 
9 

294 
26 
1. 
3. 
0. 
0. 
5 
3 
6 
3 
0 
9 
0 
0 
1 . 
3. 
0 . 
1332 
7144 
1109 . 
3 
0 
33 
0 
2 



53061 



9457 
78575 
429456 
113476 



94239 
77287 
428725 



22 

77287 

579503 

8411 

0790766 

37739 



3G3 
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FILE: NWLPDATA, 
EL : NONE 



NO. OF VARIABLES: 78, NO. OF CASES: 320 (MISS. CASES: 0) 



SUMMARY STATISTICS 



ss r 



a r 



to r 



wp_r 



Mean 
Maximum 
Minimum 
Range 

Valid Observations 
Missing Values 
Sample Standard Dev. 

Sample Variance 
Sample Coef. Of Var. 
Standard Error Of Mean 

Median 
First Quartile 
Third Quartile 
Interquartile Range 
Lower Adjacent Value 
Upper Adjacent Value 
Minor Outliers 
Major Outliers 
Standard Deviation 
Variance 
Coefficient Of Var. 

Sum 

Sum Of Squares 
Sum Of Squared Dev. 

Second Moment 
Third Moment 
Fourth Moment 
Coefficient Of Skewness 
Coefficient Of Kurtosis 



4.14286 
9 
0 
9 

294 
26 
2.22459 
4.94881 
0.53697 
0.129741 
4 
2 
6 
4 
0 
9 
0 
0 
2 
4 
0 

1218 

6496 

1450 

4.93197 
0.0466472 
53.0969 
0.00425887 
2.18287 



2208 

93197 

536056 



4 

9 
0 
9 

294 
26 
2 



,43197 



02555 
10287 
457032 
,118133 



0 

1303 
6977 
1202 
4 



4. 
0. 
0 
5 
3 
6 
3 
0 
9 
0 
0 

2.02211 
4 .08891 
456254 



14 

08891 
-1.76385 
40.4248 
-0.21333 
2.41787 



4.55782 

9 

0 

9 

294 
26 
2.25243 
5.07344 
0.49419 
0.131364 
5 
3 
6 
3 
0 
9 
0 
0 

2.2486 

5.05618 

0.493348 



1340 
7594 
1486 
5 



0. 



52 

05618 
269823 
57.0653 
0.0237326 
2.23217 



4.68707 

9 

0 

9 

294 
26 
2.292 
5.25328 
0.489005 
0.133672 
5 
3 
6 
3 
0 
9 
0 
0 

2.2881 
5.23541 
0.488173 
1378 
7998 
1539.21 

5.23541 
-0.0408765 
61.9925 
-0.0034123 
2.26171 



ERIC 



370 



- 12 - 



ft 



FILE: NWLPDATA, 
ABEL: NONE 



NO. OF VARIABLES: 78, NO. OF CASES: 320 (MISS. CASES: 0) 



SUMMARY STATISTICS 



c r 



ctl r 



inn r 



com r 



Mean 
Maximum 
Minimum 
Range 

Valid Observations 
Missing Values 
Sample Standard Dev. 

Sample Variance 
Sample Coef . Of Var . 
Standard Error Of Mean 

Median 
First Quartile 
Third Quartile 
Interquartile Range 
Lower Adjacent Value 
Upper Adjacent Value 
Minor Outliers 
Major Outliers 
Standard Deviation 
Variance 
Coefficient Of Var. 

Sum 

Sum Of Squares 
Sum Of Squared Dev. 

Second Moment 
Third Moment 
Fourth Moment 
Coefficient Of Skewness 
Coefficient Of Kurtosis 



3. 
9 
0 
9 

294 
26 
2. 
5. 
0. 
0. 
4 
2 
5 
3 
0 
9 
0 
0 

2. 

5. 

0. 
1113 
5905 
1691. 

5. 

4. 
74, 

0, 

2 



78571 



40271 
77304 
634679 
140129 



39862 

7534 

633599 



5 

7534 

80029 

6123 

347841 

25404 



4. 

9 
0 
9 

294 
26 
1. 
3. 
0. 
0. 
5 
3 
6 
3 
0 
9 
0 
0 
1. 
3. 
0 . 
1431 
8073 
1107 . 
3 . 
-1 , 
33 , 
-0 
2 



86735 



94447 
78098 
399494 
113404 



94116 
76812 
398814 



83 

76812 

56954 

2486 

214578 

34167 



3. 
9 
0 
9 

294 
26 
2. 
4. 
0. 
0. 
3 
2 
5 
3 
0 
9 
0 
0 

2. 

4. 

6. 
997 
4743 
1362. 

4. 

3. 
48. 

0. 

2 



39116 



15604 
64852 
635784 
125743 



15237 
63271 
634702 



02 

63271 

50721 

8178 

35173 

27462 



2. 

9 
0 
9 

294 
26 
1. 
3. 
0. 
0. 
2 
1 
3 
2 
0 
6 
15 
0 

1. 

3. 

0. 
669 
2653 
1130. 

3. 

7. 
54. 

1. 

3. 



27551 



96443 
85899 
863292 
114568 



96109 
84586 
861823 



68 

84586 

79016 

5182 

03289 

68599 



9 
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FILE: NWLPDATA, 
ABEL : NONE 



NO. OF VARIABLES: 78, NO. OF CASES: 320 (MISS. CASES: 0) 



SUMMARY STATISTICS 



1 s 



pc_s 



ss s 



Mean 
Maximum 
Minimum 
Range 

Valid Observations 
Missing Values 
Sample Standard Dev. 

Sample Variance 
Sample Coef. Of Var. 
Standard Error Of Mean 

Median 
First Quartile 
Third Quartile 
Interquartile Range 
Lower Adjacent Value 
Upper Adjacent Value 
Minor Outliers 
Major Outliers 
Standard Deviation 
Variance 
Coefficient Of Var. 

Sum 

Sum Of Squares 
Sum Of Squared Dev. 

Second Moment 
Third Moment 
Fourth Moment 
Coefficient Of Skewness 
Coefficient Of Kurtosis 



32. 
72 
8 
64 
293 
27 
18. 
333. 
0. 
1. 
29 
15 
50 
35 
8 
72 
0 
0 
18. 
332. 
0. 
9664 
416122 
97374. 
332. 
2662. 
244094 
0. 
2. 



9829 



2613 
476 
55366 
06684 



33t 

552714 



9 

338 
96 

439536 
21003 



39 . 
79 

0 
79 
293 
27 
16. 
284. 

0. 

0. 
44 
27 
53 
26 

0 
79 

0 

0 

16, 
283 

0, 

11673 
548153 
83105 
283 
359 
194122 
0 
2 



8396 



8703 
608 

423456 
985575 



8415 
636 

422733 



5 

636 
157 

0751867 
41296 



39. 
99 

9 
90 
293 
27 
16. 
267. 

0. 

0. 
38 
23 
52 
29 

9 
74 

1 

0 

16 . 
266 

0 . 

11448 
525318 
78025 
266 
568 
184820 
0 
2 



0717 



3466 
211 

418374 
954977 



3187 

299 

41766 



5 

299 
512 

130824 
60622 



ERIC 
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FILE: NULPDATA, 
EL: NONE 



NO. OF VARIABLES: 78, NO. OF CASES: 320 (MISS. CASES: 0) 



Mean 
Maximum 
Minimum 
Range 

Valid Observe. t ions 
Missing Values 
Sample Standard Dev. 

Sample Variance 
Sample Coef . Of Var. 
Standard Error Of Mean 

Median 
First Quart ile 
Third Quartile 
Interquartile Range 
Lower Adjacent Value 
Upper Adjacent Value 
Minor Outliers 
Major Outliers 
Standard Deviation 
Variance 
Coefficient Of Var. 

Sum 

Sum Of Squares 
Sum Of Squared Dev. 

Second Moment 
Third Moment 
Fourth Moment 
Coefficient Of Skewness 
Coefficient Of Kurtosis 



SUMMARY STATISTICS 



a s 



to s 



40. 
78 

5 
73 
293 
27 
16. 
277. 

0. 

0. 
46 
29 
54 
25 

5 
78 

0 

0 
16. 
277. 

0. 

11999 
572551 
81165. 
277. 
-947. 
179592 
-0 
2 



9522 



6722 
963 

407114 
974002 



6438 
015 

406419 



3 

015 
861 

205584 
34035 



39. 
74 

4 
70 
293 
27 
17. 
303. 

0. 

1. 
43 
28 
51 
23 

4 
74 

0 

0 
17. 
302. 

0. 

11596 
547436 
8S503. 
302. 
98. 
204602 
0 
2 



5768 



4096 
094 

439894 
01708 



3799 
06 

439143 



5 

06 

6159 

0187848 
24246 



wp_s 



51. 
83 

4 
79 
293 
27 
16. 
283. 

0. 

0. 
54 
40 
62 
22 
18 
83 

1 

0 
16. 
282. 

0. 

15227 
874201 
82864. 
282. 
-330. 
188635 
-0 
2 



9693 



8459 
783 
32415 
984146 



8171 
815 

323597 



7 

815 

283 

0694438 
3584 



ERIC 



73 



- 15 - 



0 



FILE: NWLPDATA, NO. OF VARIABLES: 78, NO. OF CASES: 320 (MISS. CASES: 0) 
BEL : NONE 



SUMMARY STATISTICS 



c s 



ctl s 



mn s 



Mean = 
Maximum = 
Minimum = 
Range = 
Valid Observations = 
Missing Values = 
Sample Standard Dev. = 
Sample Variance = 
Sampla Coef. Of Var. = 
Standard Error Of Mean = 

Median = 
First Quartile = 
Third Quartile = 
Interquartile Range = 
Lower Adjacent Value = 
Upper Adjacent: Value = 
Minor Outliers = 
Major Outliers = 
Standard Deviation = 
Variance = 
Coefficient Of Var. = 

Sum = 

Sum Of Squares = 
Sum Of Squared Dev. = 
Second Moment = 
Third Moment = 
Fourth Moment = 
Coefficient Of Skewness = 
Coefficient Of Kurtosis = 



35. 
76 

7 
69 
293 
27 
18. 
348. 

0. 

1. 
38 
22 
45 
23 

7 
76 

0 

0 
18 
347 

0 

10531 
480357 
101852 
347 
2289 
270963 
0 
2 



942 



6764 
808 

519627 
09109 



6445 
618 

518739 



618 

5 

353254 
24236 



49. 
81 
13 
68 
293 
27 
14. 
214. 

0. 

0. 
51 
36 
58 
22 
13 
81 

0 

0 

14. 
213. 
0. 

14597 
789703 
62493 
213 
-659 
106069 
-0 
2 



8191 



6294 
019 
29365 
854657 



6044 
288 

293148 



4 

288 
681 

211779 
33161 



43. 
80 
21 
59 
293 
27 
14. 
196. 

0. 

0. 
41 
34 
54 
20 
21 
80 

0 

0 

13. 
195. 

0. 

12704 
608192 
57367 
195 
944 
87575 
0 
2 



3584 



0165 
464 

323272 
818855 



9926 

793 

32272 



4 

793 
337 
2 

344692 
28448 




274 
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FILE: NWLPDATA, 
EL : NONE 



NO. OF VARIABLES: 78, NO. OF CASES: 320 (MISS. CASES: 0) 



SUMMARY STATISTICS 







com_s 




i_r2 




pc_r2 




ss_rl 


Mean = 


30. 


1945 


3. 


79042 


4 


.55689 


3 


.88024 


Maximum = 


80 




50 




44 




31 




Minimum = 


0 




0 




0 




0 




Range - 


80 




50 




44 




31 




Valid Observations = 


293 




167 




167 




167 




Missing Values = 


27 




153 




153 




153 




Sample Standard Dev. = 


14. 


9249 


4. 


45166 


3 


.54643 


3 


.0945 


Sample Variance = 


222. 


753 


19. 


8173 


13 


.2964 


9 


.57593 


Sample Coef. Of Var. = 


0. 


494292 


1. 


17445 


0 


.800202 


0 


.79750: 


Standard Error Of Mean = 


0. 


871923 


0. 


34448 


0 


.282169 


0 


.23946 


Median = 


29 




4 




4 




4 




First Quartile = 


21 




1 




3 




2 




Third Quartile = 


36 




5 




6 




5 




Interquartile Range = 


15 




4 




3 




3 




Lower Adjacent Value = 


0 




0 




0 




0 




Upper Adjacent Value = 


58 




9 




9 




9 




Minor Outliers = 


15 




0 




0 




0 




Major Outliers = 


0 




1 




1 




1 




Standard Deviation = 


14. 


8994 


4. 


43831 


3 


.63549 


3 


.08522 


0^ Variance = 


221. 


993 


19. 


6986 


13 


.2168 


9 


.51859 


Coefficient Of Var. = 


0. 


493448 


1. 


17093 


0 


.797802 


0 


.79511 


Sum = 


8847 




633 




761 




648 




Sum Of Squares = 


332175 




5689 




5675 




4104 




Sum Of Squared Dev. = 


65043. 


9 


3289. 


66 


2207 


.21 


1589 


.6 


Second Moment = 


221. 


993 


19. 


6986 


13 


.2168 


9 


.51859 


Third Moment = 


2986. 


16 


591. 


706 


366 


.363 


120 


.607 


Fourth Moment = 


176272 




27395. 


6 


14531 


.2 


3295 


.64 


Coefficient Of Skewness = 


0. 


902828 


6. 


76789 


7 


.62467 


4 


.1069 


Coefficient Of Kurtosis = 


3. 


57688 


70. 


601 


83 


.1857 


36 


.3743 



9 

ERIC 
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FILE: NWLPDATA, 
IBEL : NONE 



NO. OF VARIABLES: 78, NO. OF CASES: 320 (MISS. CASES: 0) 



SUMMARY STATISTICS 



Mean 
Maximum 
Minimum 
Range 

Valid Observations 
Missing Values 
Sample Standard Dev. 

Sample Variance 
Sample Coef. Of Var. 
Standard Error Of Mean 

Median 
First Quartile 
Third Quartile 
Interquartile Range 
Lower Adjacent Value 
Upper Adjacent Value 
Minor Outliers 
Major Outliers 
Standard Deviation 
Variance 
Coefficient Of Var. 

Sum 

Sum Of Squares 
Sum Of Squared Dev. 

Second Moment 
Third Moment 
Fourth Moment 
Coefficient Of Skewness 
Coefficient Of Kurtosis 



a r2 



to r2 



wp_r2 



c r2 



4. 

46 
0 
46 
167 
153 
3. 
14. 
0. 
0. 
5 

3 
6 
3 
0 
9 
0 
1 

3. 
14. 
0. 
810 
6350 
2421. 
14. 
413. 
17217, 
7 
81 



8503 



81915 
5859 
787405 
295535 



8077 
4985 
785043 



26 

4985 

215 

4 

48496 
9064 



4 

51 

0 
c ■• 

167 
153 
4. 
18. 
0. 
0. 
5 
3 
7 
4 
0 
9 
0 
1 
4. 
18. 
0. 
816 
7018 
3030 
18 
581 
27140 
7 

82 



,88623 



27295 
2581 
874488 
33065 



26013 

1487 

871865 



84 

1487 

471 

9 

52071 
4008 



5. 

54 
0 

54 
167 
153 
4. 

19. 
0. 
0. 
5 
3 
7 
4 
0 
9 
0 
1 

4. 
19. 
0. 
843 
7509 
3253. 
19. 
697. 
34443 
8. 
90 



0479 



4272 
6001 
877037 
342587 



41393 

4827 

874407 



62 

4827 
344 

10909 
7405 



3. 
22 
0 
22 
167 
153 
2. 
7. 
0. 
0. 
3 
2 
5 
3 
0 
9 
0 
1 

2. 
7. 
0. 
605 
3453 
1261. 
7. 
40. 
748. 
1. 
13, 



62275 



75641 
59779 
76086 
213297 



74814 

5523 

758579 



23 

5523 

7386 

568 

96285 

1242 



O 



76 
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FILE: NWLPDATA, 
^BEL : NONE 



NO. OF VARIABLES: 78, NO. OF CASES: 320 (MISS. CASES: 0) 



SUMMARY STATISTICS 



ctl r2 



inn r2 



com r2 



i s2 



Mean 
Maximum 
Minimum 
Range 

Valid Observations 
Missing Values 
Sample Standard Dev. 

Sample Variance 
Sample Coef. Of Var. 
Standard Error Of Mean 

Median 
First Quartile 
Third Quartile 
Interquartile Range 
Lower Adjacent tfalue 
Upper Adjacent Value 
Minor Outliers 
Major Outliers 
Standard Deviation 
Variance 
Coefficient Of Var. 

Sum 

Sum Of Squares 
Sum Of Squared Dev. 

Second Moment 
Third Moment 
Fourth Moment 
Coefficient Of Skewness 
Coefficient Of Kurtosis 



5.02994 4.. 01198 2.33533 '32. 

51 67 58 72 

0 0 0 8 

51 67 58 64 

167 167 167 165 

153 153 153 155 

4.14849 5.37956 4.79157 18. 

17.2099 28.9396 22.9592 341. 

0.824759 1.34087 2.05178 0. 

0.32102 -0.416282 0.370783 1. 

5 3 1 29 
3 2 0 15 

6 5 3 43 
3 3 3 28 
0 0 ************ 8 

9 9 7 72 

0 0 5 0 

111 0 

4.13605 5.36342 4.7772 18. 

17.1069 28.7663 22.8217 339. 

0.822286 1.33685 2.04562 0. 

840 670 390 5362 

7082 7492 4722 230334 

2856.85 4803.98 3811.22 56085. 

17.1069 28.7663 22.8217 339. 

576.936 1493.84 1038.84 2537. 

26791.7 94309.2 57549.6 245886 

8.15401 9.68228 9.52852 0. 

91.55 113.969 110.496 2. 



497 



4928 
983 

569062 
43966 



4367 
911 

567335 



2 

911 
2 

404862 
12816 



°77 



FRir 
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FILE: NWLPDATA, 
BEL : NONE 



NO. OF VARIABLES: 78, NO. OF CASES: 320 (MISS. CASES: 0) 



Mean 
Maximum 
Minimum 
Range 

Valid Observations 
Missing Values 
Sample Standard Dev. 

Sample Variance 
Sample Coef . Of Var . 
Standard Error Of Mean 

Median 
First Quartile 
Third Quartile 
Interquartile Range 
Lower Adjacent Value 
Upper Adjacent Value 
Minor Outliers 
Major Outliers 
Standard Deviation 
Variance 
Coefficient Of Var. 

Sum 

Sum Of Squares 
Sum Of Squared Dev. 

Second Moment 
Third Moment 
Fourth Moment 
Coefficient Of Skewness 
Coefficient Of Kurtosis 



SUMMARY STATISTICS 

pc_s2 ss_s2 



38 
79 
0 
79 
165 
155 

17. 
294. 
0. 
1. 
35 
27 
53 
26 
0 
79 
0 
0 
17 . 
292. 
0. 
6270 
286546 
48286 
292. 
1130. 
222821 
0. 
2. 



1589 
427 

451549 
33582 



1068 
642 

450179 



642 
07 

225736 
60185 



35. 
74 
9 
65 
165 
155 
16, 
274, 
0, 
1 
38 
23 
45 
22 
9 
74 
0 
0 
16 
272 
0 

5903 
256199 
45014 
272 
1455 
164712 
0 
2 



7758 



5674 
48 

463091 
28977 



5172 
816 

461686 



7 

816 

,54 

.323011 
.21302 



a s2 



42. 
78 
5 
73 
165 
155 

17. 
295. 
0. 
1. 
41 
29 
54 
25 
5 
78 
0 
0 
17 . 
293. 
0. 
6975 
343243 
48390. 
293, 
-329. 
206282 
-0. 
2. 



2727 



1775 
065 

406349 
33726 



1253 
277 

405115 



7 

277 
592 

0656236 
39831 



»> ( O 



9 

ERLC 
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FILE: NWLPDATA, 
*ABEL : NONE 



NO. OF VARIABLES: 78, NO. OF CASES: 320 (MISS. CASES: 0) 



Mean 
Maximum 
Minimum 
Range 

Valid Observations 
Missing Values 
Sample Standard Dev. 

Sample Variance 
Sample Coef. Of Var. 
Standard Error Of Mean 

Median 
First Quartile 
Third Quartile 
Interquartile Range 
Lower Adjacent Value 
Upper Adjacent Value 
Minor Outliers 
Major Outliers 
Standard Deviation 
Variance 
Coefficient Of Var. 

Sum 

Sum Of Squares 
Sum Of Squared Dev. 

Second Moment 
Third Moment 
Fourth Moment 
Coefficient Of Skewness 
Coefficient Of Kurtosis 



SUMMARY STATISTICS 



to s2 



wp_s2 



46. 
83 
4 
79 
165 
155 

18. 
346. 
0. 
1. 
47 
33 
62 
29 
4 
83 
0 
0 
18. 
343. 
0. 
7685 
414685 
56750. 
343 . 
-486. 
266354 
-0. 
2. 



5758 



6021 
038 

399395 
44817 



5457 
941 

398183 



3 

941 
75 

0763097 
2516 



46. 
83 
4 
79 
165 
155 

18. 
329. 
0. 
1. 
47 
33 
59 
26 
4 
83 
0 
0 
18. 
327. 
0. 
7622 
406158 
54067. 

327. 
-1501. 
256506 
-0. 
2. 



1939 



1571 
682 

393063 
41353 



102 
684 
39187 



8 

684 
85 

253188 
38885 



c s2 



33. 
76 

7 
69 
165 
15F 
18. 
339 

0. 

1. 
30 
14 
45 
31 

7 
76 

0 

0 
18 
336 

0 

5529 
240871 
55599 
336 
2818 
253058 
0 
2 



5091 



4125 
02 

549477 
43341 



3566 

965 

54781 



2 

965 
43 

,455649 
.2287 



t 



79 



ERIC 
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FILE: NWLPDATA, 
BEL : NONE 



NO. OF VARIABLES: 78, NO. OF CASES: 320 (MISS. CASES: 0) 



SUMMARY STATISTICS 



Ctl s2 



inn s2 



com s2 



Mean 
Maximum 
Minimum 
Range 

Valid Observations 
Missing Values 
Sample Standard Dev. 

Sample Variance 
Sample Coef. Of Var. 
Standard Error Of Mean 

Median 
First Quartile 
Third Quartile 
Interquartile Range 
Lower Adjacent Value 
Upper Adjacent Value 
Minor Outliers 
Major Outliers 
Standard Deviation 
Variance 
Coefficient Of Var. 

Sum 

Sum Of Squares 
Sum Of Squared Dev. 

Second Moment 
Third Moment 
Fourth Moment 
Coefficient Of Skewness 
Coefficient Of Kurtosis 



48.8182 44.7394 27.9879 

81 80 73 

13 21 12 

68 59 61 

165 165 165 

155 155 155 

15.8485 14.4732 15.4427 

251.174 209.474 238.475 

0 .324643 0 .323501 0.551762 

1.2338 1.12674 1.20221 

51 41 21 

36 34 12 

58 54 36 

22 20 24 

^2 21 ************* 

81 80 66 

0 0 4 

0 0 0 

15.8004 14.4293 15.3958 

249.652 208.205 237.03 

0.323658 0.322519 0.550088 

8055 7382 4618 

434423 364620 168358 

41192.5 34353.8 39110 

249.652 208.205 237.03 

-467.057 878.135 3759.7 

151999 95569.2 195490 

-0.118404 0.292298 1.03026 

2.43877 2.20463 3.4795 




FILE: NWLPDATA, NO. OF VARIABLES: 78, NO. OF CASES: 320 (MISS. CASES: 155) 
■ABEL : NONE 



HYPOTHESIS: MEAN X = MEAN Y (Matched Pairs) 



X = r ss 



Y = r_ss2 if 



MEAN OF DIFFERENCES = -9.52727 

SAMPLE VARIANCE = 4495.81 

SAMPLE SIZE = 165 

t = -1.82518 

D. F. = 164 

P-VALUE = 0.0697927 

P-VALUE/2 = 0.0348963 

SD. ERROR = 5.2199 
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ERIC 



3Si 



FILE: NWLPDATA, NO. OF VARIABLES: 78, NO. OF CASES: 320 (MISS. CASES: 163) 
ABEL : NONE 



HYPOTHESIS: MEAN X = MEAN Y (Matched Pairs) 



MEAN OF DIFFERENCES = -7.18471 
SAMPLE VARIANCE = 276.69 
SAMPLE SIZE = 157 



t = -5.41206E0 

D. F. = 1.56000E2 

P-VALUE = 2.30597E-7 

P-VALUE/2 = 1.15299E-7 

SD. ERROR = 1.32754E0 



X = r-perc 
Y = r_perc2 



7 3 OS 
75,7 i 




FILE: NWLPDATA, NO. OF VARIABLES: 78, NO. OF CASES: 320 (MISS. CASES: 158) 
ABEL : NONE 



HYPOTHESIS: MEAN X = MEAN Y (Matched Pairs) 



X = r_stan 
Y = r stan2 



MEAN OF DIFFERENCES 
SAMPLE VARIANCE 
SAMPLE SIZE 



-0.580247 
1 .56184 
162 



6. 



t = 



D. F. 
P-VALUE 
P -VALUE/ 2 
SD. ERROR 



-5.90951E0 
1.61000E2 
1.98401E-8 
9.92005E-9 
9.81886E-2 




OC.O 



ERIC 



FILE: NWLPDATA, NO. OF VARIABLES: 78, NO. OF CASES: 320 (MISS. CASES: 156) 
ABEL : NONE 



HYPOTHESIS: MEAN X = MEAN Y (Matched Pairs) 



X 
Y 



MEAN OF DIFFERENCES 
SAMPLE VARIANCE 
SAMPLE SIZE 

4. 

c 

D. F. 
P-VALUE 
P -VALUE/ 2 
SD. ERROR 



r_ge 
r_ge2 

-0.5554^8 
3.3417-i 
164 

-3,89143 
163 

0.000144962 

0.0000724811 

0.142746 



ERIC 



3S4 



FILE: NWLPDATA , NO. OF VARIABLES: 78, NO. OF CASES: 320 (MISS. CASES: 152) 
BEL : NONE 



HYPOTHESIS: MEAN X = MEAN Y (Matched Pairs) 

3 

17 /, (tb 



X = m_ss 
Y = m ss2 



MEAN OF DIFFERENCES = -12.4167 
SAMPLE VARIANCE = 1202.32 
SAMPLE SIZE = 168 



t 

D. F. 
P-VALUE 
P-VALUE/2 
SD. ERROR 



-4.64141 
167 

0.00000696697 
0.00000348348 
2.67519 



ERIC 



FILE: NWLPDATA, NO. OF VARIABLES: 78, NO. OF CASES: 320 (MISS. CASES: 160) 
ABEL : NONE 



HYPOTHESIS: MEAN X = MEAN Y (Matched Pairs) 



MEAN OF DIFFERENCES = -6.18125 
SAMPLE VARIANCE = 385.709 
SAMPLE SIZE = 160 



t = -3.98113 

D. F. = 159 

P-VALUE = 0.000104078 

P-VALUE/2 = 0.000052039 

SD. ERROR = 1.55264 



4 



v 



X = 



m_perc 
n\jperc2 



6 I. 7/ 

7 0.Pt 
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FILE: NWLPDATA, NO. OF VARIABLES: 78, NO. OF CASES: 320 (MISS. CASES: 153) 
■ABEL : NONE 



HYPOTHESIS: MEAN X = MEAN Y (Matched Pairs) 



X 
Y 



MEAN OF DIFFERENCES 
SAMPLE VARIANCE 
SAMPLE SIZE 

t 

D. F. 
P -VALUE 
P -VALUE/ 2 
SD. ERROR 



ra_stan 
m_stan2 

-0.532934 
2.23837 
167 

-4.60327 
166 

0.00000823155 
0.00000411578 
0.115773 



FRir 



3S7 



FILE: NWLPDATA, NO. OF VARIABLES: 78, NO. OF CASES: 320 (MISS. CASES: 152) 
ABEL: NONE 



HYPOTHESIS: MEAN X = MEAN Y (Matched Pairs) 



X = m_ge 
Y = m_ge2 



MEAN OF DIFFERENCES 
SAMPLE VARIANCE 
SAMPLE SIZE 

t 

D. F. 
P -VALUE 
P -VALUE/ 2 
SD. ERROR 



-0.756548 
3.48127 
168 

-5.25559E0 
1.67000E2 
4.45639E-7 
2.22819E-7 
1. 439 5 IE- 1 



?,* 7 



ERLC 



f>8 



FILE: NWLPDATA, NO. OF VARIABLES: 78, NO. OF CASES: 320 (MISS. CASES: 297) 
ABEL : NONE 



HYPOTHESIS: MEAN X = MEAN Y (Matched Pairs) 

?7, $ 3 



X = tals_d 
Y = tals d2 



MEAN OF DIFFERENCES 
SAMPLE VARIANCE 
SAMPLE SIZE 

t 

D. F. 
P -VALUE 
P -VALUE/ 2 
3D. ERROR 



-0.434783 
804.348 
23 

-0.0735215 
22 

0.942056 
0.471028 
5.91368 



ERIC 



S9 



FILE: NWLPDATA, NO. OF VARIABLES: 78, 10. OF CASES: 320 (MISS. CASES: 297) 
.ABEL : NONE 



HYPOTHESIS: MEAN X = MEAN Y (Matched Pairs) 



MEAN OF DIFFERENCES = -3.47826 
SAMPLE VARIANCE = 787.352 
SAMPLE SIZE = 23 



t = -0.594486 

D. F. = 22 

P-VALUE = 0.558252 

P-VALUE/2 = 0.279126 

SD. ERROR = 5.85087 



X = tals_q 
Y = tals_q2 



2-? 7, ftf 
3 07. S3 





ERIC 



31)0 



FILE: NWLPDATA, NO. OF VARIABLES: 78, NO- OF CASES: 320 (MISS. CASES: 125) 
ABEL : NONE 



HYPOTHESIS: MEAN X = MEAN Y (Matched Pairs) 



X 
Y 



MEAN OF DIFFERENCES 
SAMPLE VARIANCE 
SAMPLE SIZE 



pre_tl 
post_tl 



-24 
291 
195 



6872 
.134 



6 5. tf 



t 

D. F. 
P -VALUE 
P -VALUE/ 2 
SD. ERROR 



-2.02042E1 
1 .94O00E2 
1.32427E-49 
6.62133E-50 
1.22188E0 



FILE: NWLPDATA, NO. OF VARIABLES: 78, NO. OF CASES: 320. (MISS. CASES: 188) 
ABEL: NONE 

I '1^- 



HYPOTHESIS: MEAN X = MEAN Y (Matched Pairs) 



MEAN OF DIFFERENCES = -29.447 
SAMPLE VARIANCE = 204.936 
SAMPLE SIZE = 132 



t = -2.36330E1 

D. F. = 1.31000E2 

P-VALUE = 4.40581E-49 

P-VALUE/2 = 2.20290E-49 

SD. ERROR = 1.24601E0 



X = pre_t2 
Y = post_t2 



// ?. 4 ? 

72. 





FILE: NWLPDATA, NO. OF VARIABLES: 78, NO. OF CASES: 320 (MISS. CASES: 282) 
j ABEL : NONE ~ 

Z3. 

HYPOTHESIS: MEAN X = MEAN Y (Matched Pairs) 

X = comp_l 2 ? 

Y = comp_2 



MEAN OF DIFFERENCES = 7.42105 

SAMPLE VARIANCE = 440.521 

SAMPLE SIZE = 38 

t = 2.17959 

D. F. = 37 

P-VALUE = 0.0357273 

P-VALUE/2 = 0.0178637 

SD. ERROR = 3.4048 



ERIC 



O (> v o 



?5\ 



FILE: NWLPDATA, NO. OF VARIABLES: 78, NO. OF CASES: 320 (MISS. CASES: 161) 
ABEL: NONE 



HYPOTHESIS: MEAN X = MEAN Y (Matched Pairs) 



X 
Y 



MEAN OF DIFFERENCES 
SAMPLE VARIANCE 
SAMPLE SIZE 

t 

D. F. 
P -VALUE 
P-VALUE/2 
SD. ERROR 



i_r 
i_r2 

-0.0125786 
16.6201 
159 

-0.0389058 
158 

0.969015 
0.484507 
0.323309 



r~ ~7 

— ; / 



OP A 



FILE: NWLPDATA, NO. OF VARIABLES: 78, NO. OF CASES: 320 (MISS. CASES: 161) 
ABEL : NONE 



HYPOTHESIS: MEAN X = MEAN Y (Matched Pairs) 



MEAN OF DIFFERENCES = 0.0440252 
SAMPLE VARIANCE = 12.9537 
SAMPLE SIZE = 159 



t = 0.154242 

D. F. = 158 

P-VALUE = 0.877616 

P-VALUE/2 = 0.438808 

SD. ERROR = 0.28543 



X = pc_r 
Y = pc_r2 




ERIC 



FILE: NWLPDATA, NO. OF VARIABLES: 78, NO. OF CASES: 320 (MISS. CASES: 161) 
ABEL : NONE 



HYPOTHESIS: MEAN X = MEAN Y (Matched Pairs) 



MEAN OF DIFFERENCES = 0.232704 
SAMPLE VARIANCE = 8.52146 



SAMPLE SIZE = 159 

t = 1.00519 

D. F. = 158 

P-VALUE = 0.316344 

P-VALUE/2 = 0.158172 

SD. ERROR = 0.231504 



X = ss_r 
Y = ss r2 




FILE: NWLPDATA, NO. OF VARIABLES: 78, NO. OF CASES: 320 (MISS. CASES: 161) 
ABEL: NONE 



HYPOTHESIS: MEAN X = MEAN Y (Matched Pairs) 



MEAN OF DIFFERENCES = -0.327044 
SAMPLE VARIANCE = 14.4873 
SAMPLE SIZE = 159 



t = -1.08346 

D. F. = 158 

P-VALUE = 0.280257 

P-VALUE/2 = 0.140128 

SD. ERROR = 0.301853 



X = a_r 
Y = a r2 
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FILE: NWLPDATA, NO. OF VARIABLES: 78, NO. OF CASES: 320 (MISS. CASES: 161) 
BEL : NONE 



HYPOTHESIS: MEAN X = MEAN Y (Matched Pairs) 



MEAN OF DIFFERENCES 
SAMPLE VARIANCE 
SAMPLE SIZE 



X = to_r 
Y = to_r2 

-0.446541 
17.4259 
159 



Y.S~G> 



t 

D. F. 
P-VALUE 
P -VALUE/ 2 
SD. ERROR 



-1.34884 
158 

0.179317 

0.0896585 

0.331054 




ERIC 



2?S 



FILE: NWLPDATA, NO. OF VARIABLES: 78. NO. OF CASES: 320 (MISS. CASES: 161) 
ABEL : NONE 



HYPOTHESIS: MEAN X = MEAN Y (Matched Pairs) 



SAMPLE VARIAinCE = 19.2454 

SAMPLE SIZE = 159 

t = . -1.66313 

D. F. = 158 

P-VALUE = 0.0982687 

P-VALUE/2 = 0.0491343 

SD. ERROR = 0.347908 



X = wp_r 
Y = wp_r2 



MEAN OF DIFFERENCES 



-0.578616 




ore 
%j ■- * « 



FILE: NWLPDATA, NO. OF VARIABLES: 78, NO. OF CASES: 320 (MISS. CASES: 161) 
ABEL : NONE 



HYPOTHESIS: MEAN X = MEAN Y (Matched Pairs) 



X = c_r J 
Y = c_r2 

MEAN OF DIFFERENCES = 0.18239 
SAMPLE VARIANCE = 6.12475 
SAMPLE SIZE = 159 

t = 0.929298 

D. F. = 158 

P-VALUE = 0.354152 

P-VALUE/2 = 0.177076 

SD. ERROR = 0.196266 



>. 7? 

3, t>2~ 



4"0 



FILE: NWLPDATA, NO. OF VARIABLES: 78, NO. OF CASES: 320 (MISS. CASES: 161) 
i ABEL : NONE 



HYPOTHESIS: MEAN X = MEAN Y (Matched Pairs) 



X = ctl_r 
Y = ctl_r2 

MEAN OF DIFFERENCES = -0.421384 
SAMPLE VARIANCE = 17.815 
SAMPLE SIZE = 159 

t = -1.25888 

D. F. = 158 

P-VALUE = 0.209931 

P-VALUE/2 = 0.104966 

SD. ERROR = 0.33473 



4-n 



ERIC 



FILE: NWLPDATA, NO. OF VARIABLES: 78, NO. OF CASES: 320 (MISS. CASES: 161) 
EL : NONE 



HYPOTHESIS: MEAN X = MEAN Y (Matched Pairs) 

X = inn_r j j Cf 

Y = inn r2 ' 



MEAN OF DIFFERENCES = -0.515723 

SAMPLE VARIANCE = 26.4032 

SAMPLE SIZE = 159 

t = -1.26557 

D. F. = 158 

P-VALUE = 0.20753 

P-VALUE/2 = 0.103765 

SD. ERROR = 0.407502 



y, of 





4'-2 



FILE: NWLPDATA, NO. OF VARIABLES: 78, NO. OF CASES: 320 (MISS. CASES: 161) 
lABEL : NONE 

HYPOTHESIS: MEAN X = MEAN Y (Matched Pairs) 

X = com_r 2, 

Y = com_r2 7^1 

MEAN OF DIFFERENCES = -0.113208 

SAMPLE VARIANCE = 20.2403 

SAMPLE SIZE = 159 

t = -0.317297 

D. F. = 158 

P-VALUE = 0.751437 

P-VALUE/2 = 0.375719 

SD. ERROR = 0.356787 



ERIC 



4-3 



FILE: NWLPDATA, 
LBEL: NONE 



NO- OF VARIABLES: 78, NO- OF CASES: 320 (MISS . CASES: 164) 



HYPOTHESIS: MEAN X = MEAN Y (Matched Pairs) 



X = i_s 
Y = i s2 



MEAN OF DIFFERENCES 
SAMPLE VARIANCE 
SAMPLE SIZE 

t 

D. F. 
P-VALUE 
P-VALUE/2 
SD. ERROR 



2.09615 
209.042 
156 

1.81079 
155 

0.0721097 
0.0360548 
1.15759 



3 



X. 5° 



4*-4 



FILE: NWLPDATA, NO. OF VARIABLES: 78, NO. OF CASES: 320 (MISS. CASES: 164) 
BEL : NONE 



HYPOTHESIS: MEAN X = MEAN Y (Matched Pairs) 

x = pc_s gf, ?i 



Y = pc_s2 3^, pa 



MEAN OF DIFFERENCES = 2.51282 

SAMPLE VARIANCE = 249.542 

SAMPLE SIZE = 156 

t = 1.98679 

D. F. = 155 

P-VALUE = 0.0487081 

P-VALUE/2 = 0.024354 

SD. ERROR = 1.26476 



4n5 



FILE: NWLPDATA, NO. OF VARIABLES: 78, NO. OF CASES: 320 (MISS. CASES: 164) 
,ABEL : NONE 



HYPOTHESIS: MEAN X = MEAN Y (Matched Pairs) 



X = ss_s 
Y = ss_s2 

MEAN OF DIFFERENCES = 3.73718 
SAMPLE VARIANCE = 212.027 
SAMPLE SIZE = 156 



J>7>7? 



t 

D. F. 
P -VALUE 
P-VALUE/2 
SD. ERROR 



3.20561 
155 

0.00163691 

0.000818454 

1.16583 




4 8 
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ft 



FILE: NWLPDATA, NO. OF VARIABLES: 78, NO. OF CASES: 320 (MISS. CASES: 164) 
BEL : NONE 



HYPOTHESIS: MEAN X = MEAN Y (Matched Pairs) 
X = a_s H I . 60 



Y = a_s2 

MEAN OF DIFFERENCES = -0.320513 

SAMPLE VARIANCE = 262.503 

SAMPLE SIZE = 156 

t = -0.247082 

D. F. = 155 

P-VALUE = 0.805172 

P-VALUE/2 = 0.402586 

SD. ERROR = 1.29719 



ERIC 



4<-7 



4 



FILE: NWLPDATA, NO. OF VARIABLES: 78, NO. OF CASES: 320 (MISS. CASES: 164) 
.ABEL : NONE 



HYPOTHESIS: MEAN X = MEAN Y (Matched Pairs) 



X = to_s 
Y = to_s2 

MEAN OF DIFFERENCES = -7.85897 
SAMPLE VARIANCE = 511.425 
SAMPLE SIZE = 156 



19, 5? 



t 

D. F. 
P -VALUE 
P -VALUE/ 2 
SD. ERROR 



-4.34047 
155 

0.0000255503 
0.0000127752 
1.81063 




4^8 



FILE: NWLPDATA, NO. OF VARIABLES: 78, NO. OF CASES: 320 (MISS. CASES: 164) 
BEL : NONE 



HYPOTHESIS: MEAN X = MEAN Y (Matched Pairs) 
X = wp_s Si' 0O 



Y = wp_s2 

MEAN OF DIFFERENCES = 4.28205 

SAMPLE VARIANCE = 379.713 

SAMPLE SIZE = 156 

t = 2.74464 

D. F. = 155 

P-VALUE = 0.00677321 

P-VALUE/2 = 0.00338661 

SD. ERROR = 1.56015 



it. fi 



4 1 • 9 



ERIC 



FILE: NWLPDATA, NO. OF VARIABLES: 78, NO. OF CASES: 320 (MISS. CASES: 164) 
BEL : NONE 



HYPOTHESIS: MEAN X = MEAN Y (Matched Pairs) 

x = c_s 3 5-^ 

Y = c s2 



3 3.5 / 



MEAN OF DIFFERENCES = 2.75 

SAMPLE VARIANCE = 215.156 

SAMPLE SIZE = 156 

t = 2.34163 

D. F. = 155 

P-VALUE = 0.0204724 

P-VALUE/2 = 0.0102362 

SD. ERROR = 1.1744 



9 

ERJC 
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FILE: NWLPDATA, NO. OF VARIABLES: 78, NO. OF CASES: 320 (MISS. CASES: 164) 
fcBEL: NONE 



HYPOTHESIS: MEAN X = MEAN Y 



X 
Y 



MEAN OF DIFFERENCES 
SAMPLE VARIANCE 
SAMPLE SIZE 



t = 



D. F. 
P- VALUE 
P-VALUE/2 
SD. ERROR 



ctl_s 
ctl_s2 

-0.801282 
262.986 
156 

-0.617137 
155 

0.53805 

0.269025 

1.29839 



(Matched Pairs) 




411 



FILE: NWLPDATA, NO. OF VARIABLES: 78, NO. OF CASES: 320 (MISS. CASES: 164) 
BEL : NONE 



HYPOTHESIS: MEAN X = MEAN Y (Matched Pairs) 

X = inn_s *J $ - 3 & 

Y = inn s2 



MEAN OF DIFFERENCES = -0.628205 

SAMPLE VARIANCE = 162.7 

SAMPLE SIZE = 156 

t = -0.615135 

D. F. = 155 

P-VALUE = 0.539368 

P-VALUE/2 = 0.269684 

SD. ERROR = 1.02125 





412 



FILE: NWLPDATA, NO. OF VARIABLES: 78, NO. OF CASES: 320 (MISS. CASES: 164) 
ABEL: NONE 



HYPOTHESIS: MEAN X = MEAN Y (Matched Pairs) 



SAMPLE VARIANCE = 188.702 

SAMPLE SIZE = 156 

t = 1.59698 

D. F. = 155 

P-VALUE = 0.112306 

P-VALUE/2 = 0.0561529 

SD. ERROR = 1.09983 



X = com_s 
Y = com s2 




MEAN OF DIFFERENCES 



1.75641 
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EMPLOYES SUMMARY - SKILL ENHANCEMENT PROGRAM 




2 . 



3 . 



4 



Did you believe that the education classes you attended 
will" somehow help you at your job? 

TOTAL YES NO NO RESPONSE 

100 81 12 2 

Should Zircoa continue to maintain a Learning Lab? 

TOTAL YES NO NO RESPONSE 

100 61 11 8 

In the 1st semester what was your teacher's name and what 
was the class? 

TOTAL NO RESPONSE 

100 15 



TEACHER CLASS CONTENT PRESENTATION ENTHUSIASM 



L. 


NOT ZEN 


COMM 


III 


8 


8 


9 










9 


9 


9 


L. 


NOT ZEN 


MATH 


I 


8 


9 


9 






MATH 


11 








M . 


CANARIO 


COMM 


I 


7 


7 


6 


N . 


HOFFSTADT 


MATH 


II 


9 


8 


9 


R . 


SMITH 


COMM 


I 


7 


10 


10 


M. 


CANARIO 


MATH 


I 


6 


8 


B 



In the 2nd semester what was your teacher's name and what 
was the class? 



TOTAL 
100 



NO RESPONSE 
30 



CLASS 



CONTENT PRESENTATION ENTHUSIASM 



M. 


CANARIO 


MATH 


II 


8 


8 


8 


M. 


CANARIO 


COMM 


III 


8 


8 


8 


K . 


RUSSELL 


COMM 


III 


9 


9 


9 


L. 


NOTZEN 


COMM 


III 


9 


7 


8 


L. 


BONACCI 


COMM 


II 


10 


10 


10 


M. 


CANARIO 


COMM 


III 


8 


9 


Q 


L. 


NOTZEN 


COMM 


II 


8 


9 


9 


E. 


. FAIRCKILD 


MATH 


I 


8 


9 


9 
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Was there adequate time allotted for class instruction? 
i.e., was 2 hours twice a week too much, not enough. 

TOTAL NOT ENOUGH OK TOO MUCK NO RESPONSE 

100 22 31 34 " 8 

COMMENTS : 

NOT ENOUGH TIME: CLASS SIZE TOO BIG TO COVER MATERIAL 

WHEN MATERIAL IS NOT FULLY UNDERSTOOD . 

TOO MUCH TIME: MATERIAL WAS STRETCHED TO FILL 

ALLOTTED TIME . 

GENERAL COMMENT: MATH WAS "NOT ENOUGH TIME". 

COMMUNICATIONS WAS "TOO MUCH TIME" . 

What type of "programs" would you like to see in the 
Learning Lab? Example, metrics, shop floor math, 
blueprint readinc, computer skills, software training, 
reading skills improvement , etc 

TOTAL NO RESPONSE 

100 nn 



METRICS 


1 4 


SHOP FLOOR MATH 


20 


BLUE PRINT READING 


22 


COMPUTER SKILLS 


65 


SOFTWARE TRAINING 


4 9 


READING SKILLS IMPROVEMENT 




NETWORK 


2 


STATISTICS 


— * 


GRAMMAR 


T 


ACCOUNT I NG CLAS S 




CAD /CAM 


3 


TYPING 


4 


ALGEBRA I « II 


T 


LANGUAGE (GERMAN) 


1 


HYDRAULICS 


1 


ENGLISH 


1 


MATH 


1 


FRACTIONS 


1 


DECIMALS 


1 


PERCENTAGE 


1 


WRITING SKILLS 


1 


DRAFTING 


1 


TIME MANAGEMENT 


1 


STRESS MANAGEMENT 


1 


MAPICS TRAINING 


1 


WRITING PROGRAM 


1 
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7. What education programs would be beneficial to you as it 
relates tci your job for the future? Example, 
Trigonometry, blueprint reading, additional reading 
skills, problem solving, etc. 

TOTAL NO RESPONSE 

100 30 



TRIGONOMETRY 




5 


BLUE PRINT READING 




16 


ADDITIONAL READING SKILLS 


10 


PROBLEM SOLVING 




25 


CHEMISTRY 




1 


PHASE DIAGRAMS 




1 


COMPUTER SKILLS 




1 5 


SOFTWARE 




7 


KILN OPERATIONS 




1 


FIGURE PRESS TONAGE 




1 


CALCULATE SKRINKAGE 




1 


HEAT TREATING COURSE 




— 


VISIT CUSTOMER 






WRITING 




2 


EQUIPMENT REPAIR 




t_ 


ANALYTICAL GEOMETRY 




1 


CALCULUS 




2 


CAD 




2 


ACCOUNTING COURSES 




1 


COMMUNICATIONS III OR REPEAT 


2 


LEGAL CONTRACTS 




T_ 


UNDERSTAND QUOTES & 


C.E. 1 S 


1 


UNDERSTANDING CERAMI 


CS 


2 


TIME MANAGEMENT 




2 


MULTIPLE PRIORITIES 






TOTAL QUALITY MA I NTH 


NANCE 




STATISTICS 




2 


GRAMMAR 




1 


ADVANCED MATH 




1 


METRICS 




2 


STRESS MANAGEMENT 




4 


ADVANCED SOFTWARE 




1 


LANGUAGE (GERMAN) 




1 


MATH 




1 


FINANCE 




1 



r 



8. How would you change the educational program to fit 
your's and Zircoa's needs? 

TOTAL NO RESPONSE 

100 56 
GEAR PROGRAM TO ON-THE-JOB TRAINING. 19 
LESS THAN 4/HRS PER WEEK. (2 HRS) 7 
KEEP SAME HIGH LEVEL SUPPORT BY THE COMPANY. 
SHOULD HAVE 100% PARTICIPATION. 
SELECT COURSE TRAINING FROM SUGGESTION LIST. 
UTC CAN'T PROVIDE WHAT I WANT IN TRAINING. 
MAKE COURSES WHAT PEOPLE NEED. 

SIGN UP FOR CLASSES/NOT MANDATORY. 4 
:-:ORE MATH DETAIL REQUIRED. 
MORE COMPUTER COURSES. 

ALLOW MORE CLASS TIME. 2 
MORE LEARNING LAB TIME . 

BUILD IN h WEEKLY ALLOWANCE OF TIME FOR TRAINING. 

PR03LEM SOLVING- J03 RELATED. 

SEND EMPLOYEES TO OUTSIDE SCHOOLS. 

GROUP EMPLOYEES BY TESTING SO THAT SOME ARE 

NOT HOLDING THE CLASS UP. 2 

MAKE CLASSES ON "NON COMPANY" PAID TIMS. 2 

DROP IT. 

MORE FLEXIBLE TIMES. 

IN HOUSE TRAINING 3ETTER THAN OUTSIDE SEMINARS. 
MORE COMMUNICATION CLASSES-THIS HAS BE£N A TO? 
NEGATIVE ISSUE FOR YEARS. 

WE HAVE NO TOOLS TO WORK WITH IN PACKING. 
OPTIONAL IN THE FUTURE. 

ONLY ALLOW SO MUCK TIME PER YEAR FOR EDUCATION. 

ROLE PLAYING IS USELESS . 

MORE TIME, MORS EFFICIENT SPACE. 

MAKE CLASSES MORE INTERESTING. 

OFFER MORE SUBJECTS. 

9. Were the conference rooms adequate? 

TOTAL NO RESPONSE 

100 3 
YES NO 
77 20 

10. All things considered rate your total learning 
experience with this Federal Grant: 

TOTAL RESPONSE NO RESPONSE 
100 i 

EXCELLENT GOOD FAIR POOR 
21 49 24 4 
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11 . 



Any additional comments? 



TOTAL RESPONSE 
100 



NO RESPONSE 
67 



DON'T STOP THE TRAINING. 



2 



JOB RELATED. . . .ASKED I? I WOULD LIKE TO PARTICIPATE, I 
SAID I NEED COMPUTER TRAINING, I GOT COMMUNICATIONS II 
WHAT HAPPENED? 

KAREN RUSSELL WAS EXCELLENT INSTRUCTOR. 
THANK YOU FOR CLASSES, HELPED ALOT . 
VERY VERY GOOD. 

MCRE CLASSES. 2 
ENJOYED CLASSES, VERY INFORMATIVE. 3 
TEACHERS ARE PROFESSIONAL . 2 
TOO MUCH TIMS PER WEEK. 2 
HOLD CLASSES ON OFF SHIFT TIMES TOO. 
THANKS FOR THE CLASSES. 6 
LIKED THE INSTRUCTORS . 
OFFENSIVE. 

PROGRAM WAS THROWN TOGETHER SO THAT ALL WOULD 
PARTICIPATE . 

PROGRAM GEARED TO THE LOWEST LEVEL AND WAS 30RING TO 
OTHERS . 

OPTIONAL SIGNUP/ SELECTION OF COURSES. 
MORE TIME FOR CLASSES. 

I WORK ALOT DIDN'T HAVE TIME FOR LAB. 
MATH WAS FAIR, COMMUNICATION CLASSES GOOD. 
SELF PACED LEARNING IS BENEFICIAL. 
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